-- Logs begin at Tue 2022-09-13 11:47:09 UTC, end at Tue 2022-09-13 12:47:37 UTC. -- Sep 13 12:15:09.026596 dv-cinder-855189-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 12:15:09.036038 dv-cinder-855189-2-smb devstack@keystone.service[81418]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 12:15:09 2022] *** Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: nodename: dv-cinder-855189-2-smb Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: machine: x86_64 Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: clock source: unix Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: pcre jit disabled Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: detected number of CPU cores: 4 Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: current working directory: / Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: detected binary path: /usr/bin/uwsgi-core Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: your processes number limit is 47680 Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: your memory page size is 4096 bytes Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: detected max file descriptor number: 2048 Sep 13 12:15:09.039100 dv-cinder-855189-2-smb devstack@keystone.service[81418]: lock engine: pthread robust mutexes Sep 13 12:15:09.040619 dv-cinder-855189-2-smb devstack@keystone.service[81418]: thunder lock: enabled Sep 13 12:15:09.040619 dv-cinder-855189-2-smb devstack@keystone.service[81418]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 12:15:09.040619 dv-cinder-855189-2-smb devstack@keystone.service[81418]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 12:15:09.084693 dv-cinder-855189-2-smb devstack@keystone.service[81418]: Python main interpreter initialized at 0x5651d0aed9c0 Sep 13 12:15:09.084693 dv-cinder-855189-2-smb devstack@keystone.service[81418]: python threads support enabled Sep 13 12:15:09.084693 dv-cinder-855189-2-smb devstack@keystone.service[81418]: your server socket listen backlog is limited to 100 connections Sep 13 12:15:09.084693 dv-cinder-855189-2-smb devstack@keystone.service[81418]: your mercy for graceful operations on workers is 90 seconds Sep 13 12:15:09.085251 dv-cinder-855189-2-smb devstack@keystone.service[81418]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 12:15:09.085398 dv-cinder-855189-2-smb devstack@keystone.service[81418]: *** Operational MODE: preforking *** Sep 13 12:15:09.085793 dv-cinder-855189-2-smb devstack@keystone.service[81418]: *** uWSGI is running in multiple interpreter mode *** Sep 13 12:15:09.085793 dv-cinder-855189-2-smb devstack@keystone.service[81418]: spawned uWSGI master process (pid: 81418) Sep 13 12:15:09.086072 dv-cinder-855189-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 12:15:09.087022 dv-cinder-855189-2-smb devstack@keystone.service[81418]: spawned uWSGI worker 1 (pid: 81432, cores: 1) Sep 13 12:15:09.087604 dv-cinder-855189-2-smb devstack@keystone.service[81418]: spawned uWSGI worker 2 (pid: 81433, cores: 1) Sep 13 12:15:09.087941 dv-cinder-855189-2-smb devstack@keystone.service[81418]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 12:15:13.596784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:15:13.596784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: from cryptography.utils import int_from_bytes Sep 13 12:15:13.597670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:15:13.597670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: from cryptography.utils import int_from_bytes Sep 13 12:15:13.650196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 12:15:13.650440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 12:15:13.650520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] command line args: [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 12:15:13.650829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 12:15:13.650960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ================================================================================ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 12:15:13.651252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] admin_token = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.651501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] config_dir = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.651642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.651856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] config_source = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.651988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] debug = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.652226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.652635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.652788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.653065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.653300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.653523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.653711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] log_config_append = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.653886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.654217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] log_dir = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.654217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] log_file = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.654520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.654664 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.654928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.655162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.655429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.655574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.655763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.655990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.656223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.656484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.656717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.656950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.657206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.657451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.657729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.658239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.658423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] publish_errors = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.658658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.658891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.659054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.659302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.659538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.659777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] standard_threads = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.660008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.660253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.660460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.660640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] use_journal = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.660815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] use_json = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.660993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] use_stderr = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.661168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] use_syslog = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.661537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:13.661655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.661999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.662403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.663059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.663059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.663059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.663338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.663478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.663678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.663929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.664185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.664448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.664699 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.664935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.665184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.665432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.665669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.665925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.666181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.666428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.666663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.666915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.667183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.667437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.667688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.667922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.668153 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.668427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.668643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.668892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.669140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.669370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.669601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.669847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.670094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.670332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.670579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.670811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.671047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.671282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.671512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.671742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.671971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.672200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.672458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.672707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.672938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.673174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.673403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.673638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.673872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.674119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.674349 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.674586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.674821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.675055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.675289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.675525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.675753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.676001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.676235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.676498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.676733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.676999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.677234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.677506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.677779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.678037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.678037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.678683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.678765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.678979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.679214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.679447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.679681 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.679926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.680161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.680408 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.680658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.680896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.681140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.681375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.681610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.681843 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.682076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.682309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.682634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.682812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.683057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.683297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.683533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.683773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.684010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.684243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.684509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.684743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.684972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.685203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.685440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.685671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.685914 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.686151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.686402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.686641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.686898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.687167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.687410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.687641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.external = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.687873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.688171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.688430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.688667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.password = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.688897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.token = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.689138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.689372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.689617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.689848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.690095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.690344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.690576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.690811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.691057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.691306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.691553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.691797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.692041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.692274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.692626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.692881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.693181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.693431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.693720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.693960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.694220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.694461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.694719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.694952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.695189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.695434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.695680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.695909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.696155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.696463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.696669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.696903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.697163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.697399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.697647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.697883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.698131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.698376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.698613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.698847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.699094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.699324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.699560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.699808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.700061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.700291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.700550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.700782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.701029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.701275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.701524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.701780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.702027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.702296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.702535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.702772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.703003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.703240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.703472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.703709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.703955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.704194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.704473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.704818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.704956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.705203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.705438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.705679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.705940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.706156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.706392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.706621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.706858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.707100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.707347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.707583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.707979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.708234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.708512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.708777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.709010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.709265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.709515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.709751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.709986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.710224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.710450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.710694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.710952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.711184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.711432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.711678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.711924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.712160 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.712420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.712647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.712881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.713116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.713345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.713590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.713834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.714078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.714322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.714564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.714793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.715040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.715276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.715511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.715838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.716075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.716317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.716601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.716841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.717099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.717330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.717573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.717809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.718044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.718280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.718525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.718765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.718995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.719230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.719471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.719720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.719971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.720208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.720482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.720736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.720971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.721215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.721451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.721690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.721925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] role.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.722171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] role.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.722400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.722648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.722894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.723140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.723386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.723630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.723877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.724124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.724437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.724679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.725334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.725334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.725334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.725605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.726049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.726288 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.726539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.726789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.727041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.727293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.727526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.727780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.728030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.728266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.728526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.728759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.728989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.729238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.729492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.729739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.729975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.730209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.730439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.730675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] token.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.730911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.731159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.731396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.731652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.731899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.732141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.732407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.732653 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.732898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.733136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.733376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.733610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.733855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.734133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.734363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.734604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.734868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.735128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.735374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.735620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.735856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.736093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.736326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.736597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.736832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.737072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.737314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.737549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.737793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.738025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.738271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.738506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.738749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.738978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.739216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.739448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:13.739618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 12:15:13.770406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:13.770667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:13.770821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:13.780451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:13.811468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:13.811720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:13.869320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:13.921659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:13.921950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.087005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.087257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.087429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.087674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.087873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.088127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.113275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.113529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.113706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.113959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.114152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.114360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.114573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.127343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.141626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.141887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.142044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.142286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.142490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.142750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.142936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:14.161431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.161722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:15:14.162112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.162270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:15:14.162549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.162834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.163125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.163424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.173660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.174046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.174307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.174669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.182459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.185609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.185895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.186178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.186457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.186737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.187003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.187268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.187575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.187795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.188063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.188326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.212189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.213749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.214039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.218956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.219254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.219534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.226557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.226861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.233031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.233402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.233628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.233912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.234189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.234464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.234735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.234987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.251499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.251872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.256026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.259613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.259940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.264416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.267722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.271312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.271636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.272355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.272355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.272569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.272801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.289659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.289955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.290220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.290479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.297569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.299197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.300772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.301046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.303925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.304222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.304536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.304820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.305226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.316629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.317023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.317314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.317596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.318009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.318604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.318697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.334312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.337383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.340307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.341924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.343394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.343679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.344089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.350733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.352530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.355663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.356121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.356508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.356791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.364883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.365724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.365724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.372958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:14.373266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.373530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.373800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.374067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.374344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.374618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.374882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.375161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.375436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.375703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.375977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.376233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.376543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:14.412919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5651d0aed9c0 pid: 81432 (default app) Sep 13 12:15:14.415898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7986-be1a-4465-84da-a7fb68849c8b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:14.416232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7986-be1a-4465-84da-a7fb68849c8b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:14.416639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7986-be1a-4465-84da-a7fb68849c8b None None] PATH_INFO: `/v3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:14.420986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Tue Sep 13 12:15:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:15.079836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:15:15.079836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: from cryptography.utils import int_from_bytes Sep 13 12:15:15.080718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:15:15.080718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: from cryptography.utils import int_from_bytes Sep 13 12:15:15.129096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 12:15:15.129372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 12:15:15.129510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] command line args: [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 12:15:15.129769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 12:15:15.129966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ================================================================================ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 12:15:15.130231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] admin_token = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.130499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] config_dir = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.131187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.131412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] config_source = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.131661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] debug = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.131781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.132031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.132213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.132531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.132811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.133063 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.133242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] log_config_append = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.133431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.133685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] log_dir = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.133868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] log_file = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.134104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.134352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.134599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.134891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.135074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.135262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.135544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.135794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.136273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.136532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.136770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.137000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.137250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.137498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.137783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.138299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.138481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] publish_errors = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.138765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.138997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.139203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.139479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.139851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.140245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] standard_threads = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.140658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.141076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.141335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.141525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] use_journal = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.141814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] use_json = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.142107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] use_stderr = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.142399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] use_syslog = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.142806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:15:15.143252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.143663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.143978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.144227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.144509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.144759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.145012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.145252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.145502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.145751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.146008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.146343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.146593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.146832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.147083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.147330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.147574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.147829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.148082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.148328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.148592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.148846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.149111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.149707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.149957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.150188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.150417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.150644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.150911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.151153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.151397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.151630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.151859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.152093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.152333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.152568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.152837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.153047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.153301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.153532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.153751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.153969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.154195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.154422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.154653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.154894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.155112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.155356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.155582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.155816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.156046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.156272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.156524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.156759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.156991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.157225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.157457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.157694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.157919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.158163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.158394 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.158730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.158925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.159205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.159442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.159671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.159903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.160137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.160463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.160674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.160923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.161232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.161555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.161893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.162137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.162390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.162662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.162991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.163243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.163491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.163744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.163980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.164215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.164594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.164863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.165100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.165375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.165619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.165869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.166108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.166345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.166584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.166819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.167052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.167286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.167520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.167750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.167980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.168214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.168463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.168705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.168938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.169185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.169420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.169673 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.169932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.170173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.170402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.external = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.170632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.170926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.171158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.171388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.password = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.171617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.token = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.171855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.172087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.172330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.172586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.172831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.173077 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.173307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.173540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.173784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.174030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.174273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.174578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.174784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.175023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.175264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.175519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.175761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.176015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.176307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.176625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.176931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.177180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.177497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.177880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.178239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.178493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.178740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.178972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.179217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.179509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.179798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.180038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.180294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.180556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.180806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.181040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.181286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.181535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.181767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.182003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.182246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.182478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.182713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.182962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.183208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.183491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.183754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.183987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.184229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.184501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.184748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.185009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.185254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.185524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.185762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.185996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.186225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.186460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.186689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.186922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.187166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.187407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.187653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.187880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.188124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.188368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.188625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.188869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.189164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.189493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.189886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.190222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.190465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.190707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.190949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.191234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.191542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.191800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.192054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.192289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.192544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.192796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.193068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.193365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.193605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.193978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.194212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.194459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.194721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.194953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.195201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.195449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.195696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.195932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.196159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.196417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.196650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.196887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.197116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.197369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.197616 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.197859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.198138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.198350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.198583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.198826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.199062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.199326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.199527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.199764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.200004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.200250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.200508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.200765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.200993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.201293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.201566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.201804 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.202041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.202287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.202528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.202758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.202994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.203232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.203480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.203727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.203961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.204207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.204561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.204732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.204979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.205208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.205450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.205683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] role.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.205926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] role.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.206182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.206446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.206694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.206939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.207186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.207438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.207687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.207928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.208179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.208431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.208704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.208956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.209200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.209452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.209898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.210133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.210384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.210632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.210880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.211133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.211366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.211624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.211874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.212113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.212344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.212603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.212834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.213091 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.213338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.213590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.213811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.214076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.214378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.214613 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] token.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.214848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.215098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.215332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.215584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.215829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.216067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.216307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.216574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.216819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.217054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.217296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.217527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.217769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.218054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.218283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.218523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.218784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.219044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.219288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.219532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.219768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.220007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.220240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.220506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.220741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.220974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.221216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.221451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.221691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.221923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.222169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.222403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.222656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.222884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.223122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.223355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:15:15.223525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 12:15:15.254201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.254457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.254600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.263908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.284365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.284645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.328205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.365549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.365809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.412412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.412656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.412870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.413087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.413302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.413520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.429953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.430192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.430345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.430593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.430791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.431024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.431223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.540220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.543574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.543790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.544004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.544193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.544420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.544659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.544837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:15:15.555425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.555664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:15:15.556008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.556146 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:15:15.556378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.556689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.556953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.557208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.567104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.567411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.567674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.567968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.575408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.578417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.578743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.579104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.579558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.580017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.580272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.580579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.580900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.581181 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.581459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.581707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.607703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.609256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.609544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.614255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.614520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.614829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.621684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.621885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.626038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.626315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.626631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.626920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.627194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.627607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.627875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.628331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.644415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.644737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.649758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.653116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.653454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.657968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.661160 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.664525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.664835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.665117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.665531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.665827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.666115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.686702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.686995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.687288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.687549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.694587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.696321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.697913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.698188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.700867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.701154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.701437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.701729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.702005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.713847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.714130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.714420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.714672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.714983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.715252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.715523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.731501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.734634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.737549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.738967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.741361 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.741802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.742235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.750311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.751855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.754791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.755086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.755370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.755715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.764438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.764741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.765055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.772298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:15:15.772644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.772892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.773167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.773455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.773747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.773996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.774629 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.774896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.775169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.775436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.775711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.775957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.776219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:15:15.812368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651d0aed9c0 pid: 81433 (default app) Sep 13 12:15:21.873157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8e21-ec13-4c88-b0e4-97d6e67ae1d9 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:21.873768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8e21-ec13-4c88-b0e4-97d6e67ae1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:21.873768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8e21-ec13-4c88-b0e4-97d6e67ae1d9 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:21.874954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:15:21.885123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:21.885859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:21.885859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:21.976582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: INFO dbcounter [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] Registered counter for database keystone Sep 13 12:15:21.997992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG oslo_db.sqlalchemy.engines [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:15:22.005873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writer thread running {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:15:22.205357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG passlib.handlers.bcrypt [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81433) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 12:15:22.205661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG passlib.handlers.bcrypt [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81433) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 12:15:22.271943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:22.273681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:22.437315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1/3] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 12:15:23.055030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef8e21-ec13-4c88-b0e4-97d6e67ae1d9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:23.129961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: INFO dbcounter [None req-71ef8e21-ec13-4c88-b0e4-97d6e67ae1d9 None None] Registered counter for database keystone Sep 13 12:15:23.156700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG oslo_db.sqlalchemy.engines [None req-71ef8e21-ec13-4c88-b0e4-97d6e67ae1d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:15:23.167630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writer thread running {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:15:23.404976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef8e21-ec13-4c88-b0e4-97d6e67ae1d9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:23.413596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef161d27-2536-40c5-87f5-61ef81684f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:23.414692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161d27-2536-40c5-87f5-61ef81684f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:23.415116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161d27-2536-40c5-87f5-61ef81684f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:23.415574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161d27-2536-40c5-87f5-61ef81684f3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:23.433050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef161d27-2536-40c5-87f5-61ef81684f3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:23.538870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ef161d27-2536-40c5-87f5-61ef81684f3b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 12:15:23.539428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef161d27-2536-40c5-87f5-61ef81684f3b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:23.558897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1324 bytes} [Tue Sep 13 12:15:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:15:23.565870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:23.583133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39b5e1-d7d9-4651-a09b-212b0e7d6f68 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:23.588894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28541d2f-0a31-4e87-a45c-7ace121d981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:23.590101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28541d2f-0a31-4e87-a45c-7ace121d981b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:23.590382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28541d2f-0a31-4e87-a45c-7ace121d981b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:23.590664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28541d2f-0a31-4e87-a45c-7ace121d981b admin admin] PATH_INFO: `/v3/projects/2ed37889d9bd46b8ac01745f81e76c42` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:23.592360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28541d2f-0a31-4e87-a45c-7ace121d981b admin admin] RBAC: Authorizing `identity:get_project(project_id=2ed37889d9bd46b8ac01745f81e76c42)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:23.645329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28541d2f-0a31-4e87-a45c-7ace121d981b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 12:15:23.645641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28541d2f-0a31-4e87-a45c-7ace121d981b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:23.651289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 2/5] 10.222.0.55 () {56 vars in 1207 bytes} [Tue Sep 13 12:15:23 2022] GET /identity/v3/projects/2ed37889d9bd46b8ac01745f81e76c42 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:26.125736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe001b-3695-4442-a31c-eee65a7d6b22 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:26.126346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe001b-3695-4442-a31c-eee65a7d6b22 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:26.126604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe001b-3695-4442-a31c-eee65a7d6b22 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:26.131673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 4/6] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:26.139982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a7b5-cd67-4535-8031-e4fc08ad9b5f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:26.140615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a7b5-cd67-4535-8031-e4fc08ad9b5f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:26.140615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a7b5-cd67-4535-8031-e4fc08ad9b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:26.177056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a2e8a7b5-cd67-4535-8031-e4fc08ad9b5f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:26.179458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a2e8a7b5-cd67-4535-8031-e4fc08ad9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:26.190551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 3/7] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 12:15:26.500575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe001b-3695-4442-a31c-eee65a7d6b22 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:26.517413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe001b-3695-4442-a31c-eee65a7d6b22 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:26.522253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32862de-5fa7-4a90-a7cd-4e1a1c1a0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:26.523137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32862de-5fa7-4a90-a7cd-4e1a1c1a0ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:26.523630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32862de-5fa7-4a90-a7cd-4e1a1c1a0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:26.523974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32862de-5fa7-4a90-a7cd-4e1a1c1a0ddf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:26.534145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32862de-5fa7-4a90-a7cd-4e1a1c1a0ddf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:26.542671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32862de-5fa7-4a90-a7cd-4e1a1c1a0ddf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:26.556141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 5/8] 10.222.0.55 () {58 vars in 1324 bytes} [Tue Sep 13 12:15:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:15:26.563178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8a7b5-cd67-4535-8031-e4fc08ad9b5f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:26.575832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8a7b5-cd67-4535-8031-e4fc08ad9b5f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:26.582028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419dd5f-e81a-4a98-849a-a170ebf46090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:26.582801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419dd5f-e81a-4a98-849a-a170ebf46090 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:26.583100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419dd5f-e81a-4a98-849a-a170ebf46090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:26.583385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419dd5f-e81a-4a98-849a-a170ebf46090 admin admin] PATH_INFO: `/v3/users/53ef2f00d00d49c8b7371a64b8d190ca` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:26.585369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419dd5f-e81a-4a98-849a-a170ebf46090 admin admin] RBAC: Authorizing `identity:get_user(user_id=53ef2f00d00d49c8b7371a64b8d190ca)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:26.587402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419dd5f-e81a-4a98-849a-a170ebf46090 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:26.589175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 4/9] 10.222.0.55 () {56 vars in 1198 bytes} [Tue Sep 13 12:15:26 2022] GET /identity/v3/users/53ef2f00d00d49c8b7371a64b8d190ca => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:29.211405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44197-b182-468e-be69-b3f4d98eb8e9 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:29.212013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44197-b182-468e-be69-b3f4d98eb8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:29.212013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44197-b182-468e-be69-b3f4d98eb8e9 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:29.213533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:29.219955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15142-bcf3-469a-8b35-9069d6e25cd8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:29.220572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15142-bcf3-469a-8b35-9069d6e25cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:29.220572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15142-bcf3-469a-8b35-9069d6e25cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:29.241739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-47b15142-bcf3-469a-8b35-9069d6e25cd8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:29.242989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-47b15142-bcf3-469a-8b35-9069d6e25cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:29.344501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 5/11] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:29.608210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44197-b182-468e-be69-b3f4d98eb8e9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:29.776412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44197-b182-468e-be69-b3f4d98eb8e9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:29.818646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8241a-9447-4ae9-a855-0f29810f98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:29.819451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8241a-9447-4ae9-a855-0f29810f98c5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:29.819733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8241a-9447-4ae9-a855-0f29810f98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:29.820002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8241a-9447-4ae9-a855-0f29810f98c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:29.834102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8241a-9447-4ae9-a855-0f29810f98c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-41f8241a-9447-4ae9-a855-0f29810f98c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:29.845394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:29.847296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:29.849168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 7/12] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:29.856358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15142-bcf3-469a-8b35-9069d6e25cd8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:29.901508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:29.927980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded419-358d-4c79-b0b1-c8e077b73ca4 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:29.928449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded419-358d-4c79-b0b1-c8e077b73ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:29.928800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded419-358d-4c79-b0b1-c8e077b73ca4 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:29.930284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 8/13] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:15:29.936770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:29.937030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:29.937322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:29.956626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG passlib.handlers.bcrypt [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81432) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 12:15:29.957004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG passlib.handlers.bcrypt [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81432) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 12:15:30.007685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:30.009454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:30.030538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15142-bcf3-469a-8b35-9069d6e25cd8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:30.061542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:30.082486 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:30.083721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:30.084341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:30.084910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:30.086140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:30.086736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:30.089404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:30.109902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 6/14] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:30.116619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:30.117175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 9/15] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:15:30.270706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:30.295868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ef33-02ab-42c0-803c-e339fadbdd73 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:30.336681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e88b6-5fc4-4f14-b932-953c71e9598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:30.337324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e88b6-5fc4-4f14-b932-953c71e9598e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:30.337663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e88b6-5fc4-4f14-b932-953c71e9598e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:30.337998 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e88b6-5fc4-4f14-b932-953c71e9598e None admin] PATH_INFO: `/v3/users/53ef2f00d00d49c8b7371a64b8d190ca` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:30.339347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e88b6-5fc4-4f14-b932-953c71e9598e None admin] RBAC: Authorizing `identity:get_user(user_id=53ef2f00d00d49c8b7371a64b8d190ca)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:30.340960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e88b6-5fc4-4f14-b932-953c71e9598e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:30.342829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 7/16] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:30 2022] GET /identity/v3/users/53ef2f00d00d49c8b7371a64b8d190ca => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:30.352291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:30.449247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e88b6-5fc4-4f14-b932-953c71e9598e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:30.485244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bed2b-7579-40e6-9538-6ed7f2679f3b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:30.533374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df9b0a-084f-48c2-8d03-1be0c22d5a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:30.534492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9b0a-084f-48c2-8d03-1be0c22d5a85 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:30.534906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9b0a-084f-48c2-8d03-1be0c22d5a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:30.535309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9b0a-084f-48c2-8d03-1be0c22d5a85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:30.537891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df9b0a-084f-48c2-8d03-1be0c22d5a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:30.539832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df9b0a-084f-48c2-8d03-1be0c22d5a85 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:30.542020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 10/17] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:30.551491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df9b0a-084f-48c2-8d03-1be0c22d5a85 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:30.583650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e88b6-5fc4-4f14-b932-953c71e9598e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:30.596031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:30.633729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543cbc-5318-4643-b2ed-c406f7bae051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:30.634366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543cbc-5318-4643-b2ed-c406f7bae051 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:30.634645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543cbc-5318-4643-b2ed-c406f7bae051 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:30.634920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543cbc-5318-4643-b2ed-c406f7bae051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:30.664558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:30.688516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df9b0a-084f-48c2-8d03-1be0c22d5a85 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:30.737305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73543cbc-5318-4643-b2ed-c406f7bae051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:30.738810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:30.738983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73543cbc-5318-4643-b2ed-c406f7bae051 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:30.739933 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:30.740502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:30.740989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:30.742484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.domain.id=default, user.id=53ef2f00d00d49c8b7371a64b8d190ca) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:30.743040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:30.745754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:30.761909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 11/18] 10.222.0.55 () {56 vars in 1322 bytes} [Tue Sep 13 12:15:30 2022] GET /identity/v3/role_assignments?user.id=53ef2f00d00d49c8b7371a64b8d190ca&scope.domain.id=default&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 233 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:15:30.869350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 8/19] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:15:30.875732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:31.069187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:31.081123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee774d-31ab-4fdf-b3cd-824732073189 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:31.152150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4b2b8-41ec-4166-a747-90bb74320c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:31.153312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4b2b8-41ec-4166-a747-90bb74320c49 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:31.153842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4b2b8-41ec-4166-a747-90bb74320c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:31.154313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4b2b8-41ec-4166-a747-90bb74320c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:31.192719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4b2b8-41ec-4166-a747-90bb74320c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:31.196021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4b2b8-41ec-4166-a747-90bb74320c49 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8ac4b2b8-41ec-4166-a747-90bb74320c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:15:31.228475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:31.230388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:15:31.231963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:15:31.231963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:15:31.231963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:31.231963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 12/20] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:31.242589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543cbc-5318-4643-b2ed-c406f7bae051 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:31.340695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:31.430372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543cbc-5318-4643-b2ed-c406f7bae051 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:31.483738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e3a07-db23-41c5-b8f8-2fa842e61687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:31.484561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e3a07-db23-41c5-b8f8-2fa842e61687 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:31.484925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e3a07-db23-41c5-b8f8-2fa842e61687 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:31.485281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e3a07-db23-41c5-b8f8-2fa842e61687 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:31.486042 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e3a07-db23-41c5-b8f8-2fa842e61687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:31.486432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e3a07-db23-41c5-b8f8-2fa842e61687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:31.487972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e3a07-db23-41c5-b8f8-2fa842e61687 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:31.511781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 9/21] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:33.180437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fea17-5427-4fc9-9bf2-cfc3bd55a5a1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:33.181233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fea17-5427-4fc9-9bf2-cfc3bd55a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:33.181233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fea17-5427-4fc9-9bf2-cfc3bd55a5a1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:33.182410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 13/22] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:33.189594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b31cc-3d99-443e-85eb-611925a4c213 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:33.190114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b31cc-3d99-443e-85eb-611925a4c213 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:33.190435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b31cc-3d99-443e-85eb-611925a4c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:33.233587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ba2b31cc-3d99-443e-85eb-611925a4c213 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:33.235872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ba2b31cc-3d99-443e-85eb-611925a4c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:33.423883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 10/23] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:33.999334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fea17-5427-4fc9-9bf2-cfc3bd55a5a1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:34.265256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fea17-5427-4fc9-9bf2-cfc3bd55a5a1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:34.351240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df300a-d597-4981-b3e1-d1ff4e9473e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:34.352350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df300a-d597-4981-b3e1-d1ff4e9473e6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:34.352886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df300a-d597-4981-b3e1-d1ff4e9473e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:34.353361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df300a-d597-4981-b3e1-d1ff4e9473e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:34.386106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df300a-d597-4981-b3e1-d1ff4e9473e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e6df300a-d597-4981-b3e1-d1ff4e9473e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:34.396354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:34.398022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:34.399704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 14/24] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:15:34.410276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b31cc-3d99-443e-85eb-611925a4c213 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:34.547742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:34.706026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b31cc-3d99-443e-85eb-611925a4c213 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:34.783783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:34.784470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:34.784787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:34.785072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:34.785781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:34.786086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:34.788438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:34.801852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 11/25] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:34.808503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df300a-d597-4981-b3e1-d1ff4e9473e6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:34.842330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:35.069901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df300a-d597-4981-b3e1-d1ff4e9473e6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:35.160618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a25b46-591f-403a-909d-eda26b543181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:35.161772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a25b46-591f-403a-909d-eda26b543181 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:35.162247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a25b46-591f-403a-909d-eda26b543181 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:35.162884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a25b46-591f-403a-909d-eda26b543181 None admin] PATH_INFO: `/v3/users/53ef2f00d00d49c8b7371a64b8d190ca` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:35.169647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a25b46-591f-403a-909d-eda26b543181 None admin] RBAC: Authorizing `identity:get_user(user_id=53ef2f00d00d49c8b7371a64b8d190ca)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:35.171454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a25b46-591f-403a-909d-eda26b543181 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:35.173754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 15/26] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:34 2022] GET /identity/v3/users/53ef2f00d00d49c8b7371a64b8d190ca => generated 247 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:35.179688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:35.317449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb057d-c4c2-4743-ac55-a8910779356f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:35.326106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:35.371451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b17dfd-72a6-4e41-860d-3cdf4ba6bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:35.372107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17dfd-72a6-4e41-860d-3cdf4ba6bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:35.372403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17dfd-72a6-4e41-860d-3cdf4ba6bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:35.372688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17dfd-72a6-4e41-860d-3cdf4ba6bdd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:35.374399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b17dfd-72a6-4e41-860d-3cdf4ba6bdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:35.375984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b17dfd-72a6-4e41-860d-3cdf4ba6bdd2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:35.378284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 12/27] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:35.384495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a25b46-591f-403a-909d-eda26b543181 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:35.493649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:35.541090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a25b46-591f-403a-909d-eda26b543181 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:35.628336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e891a2d-f9c3-4054-89cb-c9a94eb38fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:35.629538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891a2d-f9c3-4054-89cb-c9a94eb38fca None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:35.630044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891a2d-f9c3-4054-89cb-c9a94eb38fca None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:35.630568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891a2d-f9c3-4054-89cb-c9a94eb38fca None admin] PATH_INFO: `/v3/domains/default/users/53ef2f00d00d49c8b7371a64b8d190ca/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:35.637979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e891a2d-f9c3-4054-89cb-c9a94eb38fca None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=53ef2f00d00d49c8b7371a64b8d190ca, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:35.640763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e891a2d-f9c3-4054-89cb-c9a94eb38fca None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:35.873843 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 16/28] 10.222.0.55 () {58 vars in 1361 bytes} [Tue Sep 13 12:15:35 2022] PUT /identity/v3/domains/default/users/53ef2f00d00d49c8b7371a64b8d190ca/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:15:36.138374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554d5f-d6a8-492e-bcc4-8056a98e4762 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:36.138917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554d5f-d6a8-492e-bcc4-8056a98e4762 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:36.139294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554d5f-d6a8-492e-bcc4-8056a98e4762 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:36.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 13/29] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:36.150426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d31fc-4a27-4d44-8333-9f020a342ef5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:36.150924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d31fc-4a27-4d44-8333-9f020a342ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:36.151409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d31fc-4a27-4d44-8333-9f020a342ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:36.198626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d37d31fc-4a27-4d44-8333-9f020a342ef5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:36.201417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d37d31fc-4a27-4d44-8333-9f020a342ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:36.364766 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757747-4c31-44f2-b432-bb398b3dc4f4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:36.365289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757747-4c31-44f2-b432-bb398b3dc4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:36.365729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757747-4c31-44f2-b432-bb398b3dc4f4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:36.368830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 14/30] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:36.375909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650e957-e4e3-444c-955c-ecf6afc06981 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:36.376425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650e957-e4e3-444c-955c-ecf6afc06981 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:36.376915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650e957-e4e3-444c-955c-ecf6afc06981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:36.390494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 17/31] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:36.438376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8650e957-e4e3-444c-955c-ecf6afc06981 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:36.440510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8650e957-e4e3-444c-955c-ecf6afc06981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:36.546068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153e402-0b40-44a2-9043-bfa3cd822170 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:36.546387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153e402-0b40-44a2-9043-bfa3cd822170 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:36.546636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153e402-0b40-44a2-9043-bfa3cd822170 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:36.551062 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 18/32] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:36.561614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1eeb9-a708-44e0-8c07-b18b2288562c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:36.561905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1eeb9-a708-44e0-8c07-b18b2288562c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:36.562199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1eeb9-a708-44e0-8c07-b18b2288562c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:36.609846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-83c1eeb9-a708-44e0-8c07-b18b2288562c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:36.610891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-83c1eeb9-a708-44e0-8c07-b18b2288562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:36.612364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 15/33] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:15:36.716208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:36.725688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 19/34] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:36.756529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650e957-e4e3-444c-955c-ecf6afc06981 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:36.937383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913461b-0dbd-4f4e-9e77-8da03b095a3d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:36.937876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913461b-0dbd-4f4e-9e77-8da03b095a3d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:36.938056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913461b-0dbd-4f4e-9e77-8da03b095a3d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:36.941147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 20/35] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:36.946032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c1d4-2277-44e8-b245-3ad11d90de4c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:36.946399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c1d4-2277-44e8-b245-3ad11d90de4c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:36.946569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c1d4-2277-44e8-b245-3ad11d90de4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:36.989920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2887c1d4-2277-44e8-b245-3ad11d90de4c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:36.991299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2887c1d4-2277-44e8-b245-3ad11d90de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:36.997844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650e957-e4e3-444c-955c-ecf6afc06981 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:37.001565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:37.109503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493d0b5-e66f-4fba-b607-6f408465eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:37.110210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d0b5-e66f-4fba-b607-6f408465eab1 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:37.110488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d0b5-e66f-4fba-b607-6f408465eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:37.110757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493d0b5-e66f-4fba-b607-6f408465eab1 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:37.111506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493d0b5-e66f-4fba-b607-6f408465eab1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:37.115066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493d0b5-e66f-4fba-b607-6f408465eab1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:37.148683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 21/36] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:15:37.150066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c1d4-2277-44e8-b245-3ad11d90de4c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:37.295493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 16/37] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Sep 13 12:15:36 2022] POST /identity/v3/roles => generated 225 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:15:37.297269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949dacc-9b1b-4dd2-9498-0bc75c7a2517 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:37.297561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949dacc-9b1b-4dd2-9498-0bc75c7a2517 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:37.304948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949dacc-9b1b-4dd2-9498-0bc75c7a2517 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:37.306615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 17/38] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:37.312860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae168bc-5111-4554-a50f-f196e48dd124 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:37.313267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae168bc-5111-4554-a50f-f196e48dd124 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:37.313510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae168bc-5111-4554-a50f-f196e48dd124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:37.334087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c1d4-2277-44e8-b245-3ad11d90de4c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:37.347152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8ae168bc-5111-4554-a50f-f196e48dd124 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:37.349120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8ae168bc-5111-4554-a50f-f196e48dd124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:37.387872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:37.409406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf964-8b08-4b39-9af1-c8e89dfee029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:37.410432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf964-8b08-4b39-9af1-c8e89dfee029 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:37.410432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf964-8b08-4b39-9af1-c8e89dfee029 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:37.410699 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf964-8b08-4b39-9af1-c8e89dfee029 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:37.413449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bf964-8b08-4b39-9af1-c8e89dfee029 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:37.415221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bf964-8b08-4b39-9af1-c8e89dfee029 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:37.455131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 22/39] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Sep 13 12:15:37 2022] POST /identity/v3/roles => generated 219 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:15:37.456046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf964-8b08-4b39-9af1-c8e89dfee029 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:37.535359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 18/40] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:37.596687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae168bc-5111-4554-a50f-f196e48dd124 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:37.643013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf964-8b08-4b39-9af1-c8e89dfee029 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:37.690770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:37.691461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:37.691781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:37.692073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:37.708798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:37.710384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:15:37.736432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:37.738202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:15:37.739697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:15:37.739697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:15:37.739697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:37.739697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 23/41] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:37.739697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:37.816862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:37.890098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:37.901381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae168bc-5111-4554-a50f-f196e48dd124 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:37.959895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c181d1-6492-46e5-bd3d-fef1fd5c7c75 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:37.979109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb25bac-0622-4604-a5e6-53276d5ad9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:37.980333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25bac-0622-4604-a5e6-53276d5ad9bc None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:37.980907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25bac-0622-4604-a5e6-53276d5ad9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:37.981833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25bac-0622-4604-a5e6-53276d5ad9bc None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:37.983206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb25bac-0622-4604-a5e6-53276d5ad9bc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:37.986561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb25bac-0622-4604-a5e6-53276d5ad9bc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:38.006520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:38.007471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:38.007903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:38.008328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:38.009327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:38.009797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:38.011430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:38.015801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 19/42] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Sep 13 12:15:37 2022] POST /identity/v3/roles => generated 223 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:15:38.017426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb25bac-0622-4604-a5e6-53276d5ad9bc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:38.036777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 24/43] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:38.046799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:38.225222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb25bac-0622-4604-a5e6-53276d5ad9bc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:38.239011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:38.250242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc092-b243-4b76-a243-8695ecbb8f5b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:38.295198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32632ca-7a46-44a3-9f10-fe14f9efb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:38.296812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32632ca-7a46-44a3-9f10-fe14f9efb80f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:38.298365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32632ca-7a46-44a3-9f10-fe14f9efb80f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:38.299060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32632ca-7a46-44a3-9f10-fe14f9efb80f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:38.303498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32632ca-7a46-44a3-9f10-fe14f9efb80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:38.306730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32632ca-7a46-44a3-9f10-fe14f9efb80f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:38.310330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 20/44] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:38.319850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32632ca-7a46-44a3-9f10-fe14f9efb80f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:38.322078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5d76-c8b8-48c8-ad4e-01f5296d5337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:38.323372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5d76-c8b8-48c8-ad4e-01f5296d5337 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:38.324055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5d76-c8b8-48c8-ad4e-01f5296d5337 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:38.324727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5d76-c8b8-48c8-ad4e-01f5296d5337 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:38.326215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed5d76-c8b8-48c8-ad4e-01f5296d5337 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:38.328692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed5d76-c8b8-48c8-ad4e-01f5296d5337 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:38.366332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:38.395106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 25/45] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:15:38 2022] POST /identity/v3/projects => generated 301 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:15:38.519624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32632ca-7a46-44a3-9f10-fe14f9efb80f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:38.576442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef9c7b-84b1-4904-8a75-7cf01e7fb48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:38.577277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9c7b-84b1-4904-8a75-7cf01e7fb48f None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:38.577681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9c7b-84b1-4904-8a75-7cf01e7fb48f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:38.578095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9c7b-84b1-4904-8a75-7cf01e7fb48f None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:38.578917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef9c7b-84b1-4904-8a75-7cf01e7fb48f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:38.580787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef9c7b-84b1-4904-8a75-7cf01e7fb48f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:38.619809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 21/46] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:15:38 2022] POST /identity/v3/projects => generated 312 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:15:39.232235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8862-2ecd-4a1b-b72b-ef472f74005f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:39.233028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8862-2ecd-4a1b-b72b-ef472f74005f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:39.233175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8862-2ecd-4a1b-b72b-ef472f74005f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:39.236271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 26/47] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:39.245329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e6c30-eb3b-4c74-bfa1-f00b77f8e177 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:39.245835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e6c30-eb3b-4c74-bfa1-f00b77f8e177 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:39.246260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e6c30-eb3b-4c74-bfa1-f00b77f8e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:39.267776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a63e6c30-eb3b-4c74-bfa1-f00b77f8e177 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:39.269859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a63e6c30-eb3b-4c74-bfa1-f00b77f8e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:39.372129 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 22/48] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:39.641599 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8862-2ecd-4a1b-b72b-ef472f74005f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:39.801299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8862-2ecd-4a1b-b72b-ef472f74005f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:39.845637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6ffb-cb9a-4ae6-8d06-a3b84311cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:39.846667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6ffb-cb9a-4ae6-8d06-a3b84311cc6b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:39.847178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6ffb-cb9a-4ae6-8d06-a3b84311cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:39.847688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6ffb-cb9a-4ae6-8d06-a3b84311cc6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:39.862183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b6ffb-cb9a-4ae6-8d06-a3b84311cc6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-126b6ffb-cb9a-4ae6-8d06-a3b84311cc6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:39.868100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:39.870187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:39.871960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 27/49] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:39.877206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e6c30-eb3b-4c74-bfa1-f00b77f8e177 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:39.879939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:40.019040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e6c30-eb3b-4c74-bfa1-f00b77f8e177 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:40.245202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:40.246239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:40.246760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:40.247259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:40.248538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:40.249103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:40.251734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:40.268335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 23/50] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:40.278390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6ffb-cb9a-4ae6-8d06-a3b84311cc6b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:40.295025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:40.426604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6ffb-cb9a-4ae6-8d06-a3b84311cc6b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:40.471592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a39d06-e8af-42bb-a433-1ece0ce20a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:40.472367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a39d06-e8af-42bb-a433-1ece0ce20a98 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:40.472738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a39d06-e8af-42bb-a433-1ece0ce20a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:40.473071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a39d06-e8af-42bb-a433-1ece0ce20a98 None admin] PATH_INFO: `/v3/users/53ef2f00d00d49c8b7371a64b8d190ca` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:40.475398 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a39d06-e8af-42bb-a433-1ece0ce20a98 None admin] RBAC: Authorizing `identity:get_user(user_id=53ef2f00d00d49c8b7371a64b8d190ca)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:40.477102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a39d06-e8af-42bb-a433-1ece0ce20a98 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:40.478966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 28/51] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:40 2022] GET /identity/v3/users/53ef2f00d00d49c8b7371a64b8d190ca => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:40.487506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:40.568442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:40.619124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec461-0136-4204-9814-e89f71eced1d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:40.665800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db889b85-7541-4258-9e55-5d3b09a89264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:40.666585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db889b85-7541-4258-9e55-5d3b09a89264 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:40.666960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db889b85-7541-4258-9e55-5d3b09a89264 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:40.667321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db889b85-7541-4258-9e55-5d3b09a89264 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:40.668796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db889b85-7541-4258-9e55-5d3b09a89264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:40.670412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db889b85-7541-4258-9e55-5d3b09a89264 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:40.672300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 24/52] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:40.679772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a39d06-e8af-42bb-a433-1ece0ce20a98 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:40.787711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:40.817352 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a39d06-e8af-42bb-a433-1ece0ce20a98 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:40.868371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8014e2-8e40-4ece-a335-31e55346688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:40.869367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8014e2-8e40-4ece-a335-31e55346688f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:40.869849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8014e2-8e40-4ece-a335-31e55346688f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:40.870343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8014e2-8e40-4ece-a335-31e55346688f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:40.871737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8014e2-8e40-4ece-a335-31e55346688f None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.domain.id=default, user.id=53ef2f00d00d49c8b7371a64b8d190ca) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:40.872285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8014e2-8e40-4ece-a335-31e55346688f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:40.874937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8014e2-8e40-4ece-a335-31e55346688f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:40.886234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 29/53] 10.222.0.55 () {56 vars in 1322 bytes} [Tue Sep 13 12:15:40 2022] GET /identity/v3/role_assignments?user.id=53ef2f00d00d49c8b7371a64b8d190ca&scope.domain.id=default&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 530 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:41.083432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a57db-6e97-4cd2-9b47-df9ed22d4371 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:41.083849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a57db-6e97-4cd2-9b47-df9ed22d4371 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:41.084215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a57db-6e97-4cd2-9b47-df9ed22d4371 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:41.085783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 25/54] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:41.092269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec823-c79b-40fd-adf5-44bcca008459 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:41.092717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec823-c79b-40fd-adf5-44bcca008459 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:41.093076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec823-c79b-40fd-adf5-44bcca008459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:41.242372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2daec823-c79b-40fd-adf5-44bcca008459 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:41.243696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2daec823-c79b-40fd-adf5-44bcca008459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:41.333913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 30/55] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:41.605526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a57db-6e97-4cd2-9b47-df9ed22d4371 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:41.775481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a57db-6e97-4cd2-9b47-df9ed22d4371 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:41.831401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:41.838106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f637c4-3986-4658-903f-c8dc93d7d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:41.838974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f637c4-3986-4658-903f-c8dc93d7d268 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:41.839328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f637c4-3986-4658-903f-c8dc93d7d268 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:41.839680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f637c4-3986-4658-903f-c8dc93d7d268 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:41.841075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f637c4-3986-4658-903f-c8dc93d7d268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:41.842734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f637c4-3986-4658-903f-c8dc93d7d268 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:41.844755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 26/56] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:41.851280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daec823-c79b-40fd-adf5-44bcca008459 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:41.960996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:42.001113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daec823-c79b-40fd-adf5-44bcca008459 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:42.047461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9940-8dbf-4ec4-924d-e5f8c84fbe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:42.048124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9940-8dbf-4ec4-924d-e5f8c84fbe63 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:42.048446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9940-8dbf-4ec4-924d-e5f8c84fbe63 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:42.048721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9940-8dbf-4ec4-924d-e5f8c84fbe63 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:42.049390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c9940-8dbf-4ec4-924d-e5f8c84fbe63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:42.051329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c9940-8dbf-4ec4-924d-e5f8c84fbe63 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:42.086253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 31/57] 10.222.0.55 () {60 vars in 1140 bytes} [Tue Sep 13 12:15:41 2022] POST /identity/v3/projects => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:15:44.418572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcc33-11b8-48f7-aec2-9747d617e0a0 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:44.419201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcc33-11b8-48f7-aec2-9747d617e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:44.419201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcc33-11b8-48f7-aec2-9747d617e0a0 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:44.420508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 27/58] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:15:44.426556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e9ba8-db91-425e-b91e-a0d3d77f3339 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:44.427111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e9ba8-db91-425e-b91e-a0d3d77f3339 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:44.427225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e9ba8-db91-425e-b91e-a0d3d77f3339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:44.449052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f43e9ba8-db91-425e-b91e-a0d3d77f3339 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:44.450324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f43e9ba8-db91-425e-b91e-a0d3d77f3339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:44.532624 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 32/59] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:45.012210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dcc33-11b8-48f7-aec2-9747d617e0a0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:45.179660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dcc33-11b8-48f7-aec2-9747d617e0a0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:45.220319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394576-ea8e-42ad-9c80-080b93d59224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:45.221016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394576-ea8e-42ad-9c80-080b93d59224 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:45.221294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394576-ea8e-42ad-9c80-080b93d59224 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:45.221564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394576-ea8e-42ad-9c80-080b93d59224 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:45.222825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394576-ea8e-42ad-9c80-080b93d59224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:45.224449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394576-ea8e-42ad-9c80-080b93d59224 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:45.226181 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 28/60] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:45.232409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e9ba8-db91-425e-b91e-a0d3d77f3339 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:45.306734 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:45.361735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e9ba8-db91-425e-b91e-a0d3d77f3339 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:45.404606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434eb8-41d0-43ca-9e83-fb6c1ae4401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:45.405362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434eb8-41d0-43ca-9e83-fb6c1ae4401a None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:45.405721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434eb8-41d0-43ca-9e83-fb6c1ae4401a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:45.406073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434eb8-41d0-43ca-9e83-fb6c1ae4401a None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:45.406841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d434eb8-41d0-43ca-9e83-fb6c1ae4401a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:45.408445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d434eb8-41d0-43ca-9e83-fb6c1ae4401a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:45.443571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 33/61] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:15:45 2022] POST /identity/v3/users => generated 275 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:15:49.619020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c750f7-fb46-4168-a433-a4cf4152084a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:49.619547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c750f7-fb46-4168-a433-a4cf4152084a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:49.619617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c750f7-fb46-4168-a433-a4cf4152084a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:49.621056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 29/62] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:49.628281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8533cb-a94d-4c21-a588-ad1c5d3c0f71 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:49.628877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8533cb-a94d-4c21-a588-ad1c5d3c0f71 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:49.629307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8533cb-a94d-4c21-a588-ad1c5d3c0f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:49.671998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9e8533cb-a94d-4c21-a588-ad1c5d3c0f71 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:49.674286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9e8533cb-a94d-4c21-a588-ad1c5d3c0f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:49.843798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 34/63] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:50.158680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac8d5-8095-4d48-b3ad-314383807fc1 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.159209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac8d5-8095-4d48-b3ad-314383807fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.159628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac8d5-8095-4d48-b3ad-314383807fc1 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.161417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 30/64] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:50.168553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0cb7-c85d-4009-a437-c296eac5787d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.169055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0cb7-c85d-4009-a437-c296eac5787d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.169565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0cb7-c85d-4009-a437-c296eac5787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.215839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f79f0cb7-c85d-4009-a437-c296eac5787d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:50.217988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f79f0cb7-c85d-4009-a437-c296eac5787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:50.267871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aac8d5-8095-4d48-b3ad-314383807fc1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:50.306242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:50.379671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 35/65] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:50.382471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f837-f097-42ae-ad3c-fb94fa4ff44b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.383280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f837-f097-42ae-ad3c-fb94fa4ff44b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.383769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f837-f097-42ae-ad3c-fb94fa4ff44b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.386428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 36/66] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:50.387208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:50.389159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993234-ed3a-46f9-8e65-239a50e6ab43 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.389786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993234-ed3a-46f9-8e65-239a50e6ab43 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.390414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993234-ed3a-46f9-8e65-239a50e6ab43 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.393338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 37/67] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:50.395996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823535b4-43c4-4507-a695-220747f2067e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.398206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823535b4-43c4-4507-a695-220747f2067e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.398830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823535b4-43c4-4507-a695-220747f2067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.429533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-823535b4-43c4-4507-a695-220747f2067e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:50.432200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-823535b4-43c4-4507-a695-220747f2067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:50.436862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aac8d5-8095-4d48-b3ad-314383807fc1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:50.497469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae185eef-759a-463a-bbf8-2b5d143821a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:50.498555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185eef-759a-463a-bbf8-2b5d143821a4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.499021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185eef-759a-463a-bbf8-2b5d143821a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.499472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185eef-759a-463a-bbf8-2b5d143821a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.515388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae185eef-759a-463a-bbf8-2b5d143821a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ae185eef-759a-463a-bbf8-2b5d143821a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:50.524828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:50.526748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:15:50.528429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 31/68] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:15:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:50.529889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ecc0-c19e-4981-8877-77991f51eb53 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.529889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ecc0-c19e-4981-8877-77991f51eb53 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.530357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ecc0-c19e-4981-8877-77991f51eb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.538841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 38/69] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:50.539689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9eac3-d9dd-454b-9980-a913ac864a3c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.539977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9eac3-d9dd-454b-9980-a913ac864a3c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.540255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9eac3-d9dd-454b-9980-a913ac864a3c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.541694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 39/70] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:50.547118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9eac3-d9dd-454b-9980-a913ac864a3c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:50.563878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9210ecc0-c19e-4981-8877-77991f51eb53 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:50.565157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9210ecc0-c19e-4981-8877-77991f51eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:50.677086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 32/71] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:50.680830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28d878-6961-4af3-9ebf-657af769cdc6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.681417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28d878-6961-4af3-9ebf-657af769cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.682041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28d878-6961-4af3-9ebf-657af769cdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.723975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dc28d878-6961-4af3-9ebf-657af769cdc6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:50.725757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dc28d878-6961-4af3-9ebf-657af769cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:50.739821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:50.753410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9eac3-d9dd-454b-9980-a913ac864a3c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:50.832432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:50.833448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:50.833778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:50.835953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:50.836833 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:50.837141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:50.840954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:50.849737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:50.858774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 40/72] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:15:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:50.859896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:50.877171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 33/73] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:50.885718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28d878-6961-4af3-9ebf-657af769cdc6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:50.993796 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb34c8-7940-4719-9c6d-c7838f0a256b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:51.029019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28d878-6961-4af3-9ebf-657af769cdc6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:51.045768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c801f9-48f4-445f-9352-86dad89df699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:51.047050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c801f9-48f4-445f-9352-86dad89df699 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:51.047679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c801f9-48f4-445f-9352-86dad89df699 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:51.048060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c801f9-48f4-445f-9352-86dad89df699 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:51.049685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c801f9-48f4-445f-9352-86dad89df699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:51.051839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c801f9-48f4-445f-9352-86dad89df699 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:51.054857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 41/74] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:51.055812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c801f9-48f4-445f-9352-86dad89df699 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:51.076433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ffe25-86ff-4649-bd2d-d488e7a2af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:51.077349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffe25-86ff-4649-bd2d-d488e7a2af05 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:51.077762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffe25-86ff-4649-bd2d-d488e7a2af05 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:51.078133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffe25-86ff-4649-bd2d-d488e7a2af05 None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:51.095201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ffe25-86ff-4649-bd2d-d488e7a2af05 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:51.095971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:51.097814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ffe25-86ff-4649-bd2d-d488e7a2af05 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:51.100921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 34/75] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:50 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:51.101658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ffe25-86ff-4649-bd2d-d488e7a2af05 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:51.177787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:51.202001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c801f9-48f4-445f-9352-86dad89df699 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:51.242889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe82db-e946-4e95-9c56-1c8330a749c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:51.243565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe82db-e946-4e95-9c56-1c8330a749c6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:51.244185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe82db-e946-4e95-9c56-1c8330a749c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:51.244185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe82db-e946-4e95-9c56-1c8330a749c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:51.255509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ffe25-86ff-4649-bd2d-d488e7a2af05 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:51.257263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe82db-e946-4e95-9c56-1c8330a749c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-acbe82db-e946-4e95-9c56-1c8330a749c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:51.262519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:51.264837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 42/76] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:15:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:51.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe82db-e946-4e95-9c56-1c8330a749c6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:51.316359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb528e-5258-4cee-a951-0c98503a4d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:51.317617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb528e-5258-4cee-a951-0c98503a4d1d None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:51.318142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb528e-5258-4cee-a951-0c98503a4d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:51.318685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb528e-5258-4cee-a951-0c98503a4d1d None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:51.320017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb528e-5258-4cee-a951-0c98503a4d1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:51.323047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb528e-5258-4cee-a951-0c98503a4d1d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:51.372723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 35/77] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:15:51 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:15:51.374412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb528e-5258-4cee-a951-0c98503a4d1d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:51.395966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:51.414085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe82db-e946-4e95-9c56-1c8330a749c6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:51.462481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fa4c-b280-4e7a-9e93-31a9e681a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:51.463248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fa4c-b280-4e7a-9e93-31a9e681a452 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:51.463605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fa4c-b280-4e7a-9e93-31a9e681a452 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:51.463946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fa4c-b280-4e7a-9e93-31a9e681a452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:51.544863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb528e-5258-4cee-a951-0c98503a4d1d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:51.547013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:51.570612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fa4c-b280-4e7a-9e93-31a9e681a452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:51.573551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fa4c-b280-4e7a-9e93-31a9e681a452 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:51.595034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f375560-dc3c-45d6-8ede-ea0c96d11f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:51.595717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f375560-dc3c-45d6-8ede-ea0c96d11f6e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:51.595990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f375560-dc3c-45d6-8ede-ea0c96d11f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:51.596266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f375560-dc3c-45d6-8ede-ea0c96d11f6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:51.609595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f375560-dc3c-45d6-8ede-ea0c96d11f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1f375560-dc3c-45d6-8ede-ea0c96d11f6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:51.615144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:51.616106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:15:51.617237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 36/78] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:51.617879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f375560-dc3c-45d6-8ede-ea0c96d11f6e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:51.740052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:51.759389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 43/79] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:15:51.759389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fa4c-b280-4e7a-9e93-31a9e681a452 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:51.774315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f375560-dc3c-45d6-8ede-ea0c96d11f6e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:51.856965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:51.857505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:51.857790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:51.858062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:51.858757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:51.859141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:51.860778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:51.872114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 37/80] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:15:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:51.873171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:51.919599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:51.971583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fa4c-b280-4e7a-9e93-31a9e681a452 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:52.048436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594371d-d027-4d10-86ea-e06dbf979c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:52.049542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594371d-d027-4d10-86ea-e06dbf979c08 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:52.050025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594371d-d027-4d10-86ea-e06dbf979c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:52.050515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594371d-d027-4d10-86ea-e06dbf979c08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:52.075127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594371d-d027-4d10-86ea-e06dbf979c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d594371d-d027-4d10-86ea-e06dbf979c08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:52.086091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:52.087797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 44/81] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:15:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:52.096904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594371d-d027-4d10-86ea-e06dbf979c08 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:52.111044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1705e-4318-4008-ac01-2f8ea11ddc5d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:52.193691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:52.195413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:52.195884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:52.196347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:52.198004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:52.198527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:52.201318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:52.202478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:52.224702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 38/82] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:52.226544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:52.323274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594371d-d027-4d10-86ea-e06dbf979c08 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:52.405955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03785c-ff03-4a1f-a39c-3d2c45c24a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:52.407775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03785c-ff03-4a1f-a39c-3d2c45c24a93 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:52.408286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03785c-ff03-4a1f-a39c-3d2c45c24a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:52.408811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03785c-ff03-4a1f-a39c-3d2c45c24a93 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:52.411627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03785c-ff03-4a1f-a39c-3d2c45c24a93 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:52.414959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03785c-ff03-4a1f-a39c-3d2c45c24a93 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:52.420281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 45/83] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:15:52 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:52.422100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03785c-ff03-4a1f-a39c-3d2c45c24a93 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:52.434763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:52.472855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36347c8a-c897-4c88-872e-adda58e130ef None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:52.548370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657c8ba-3f30-4677-adcd-8b85ef56709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:52.549556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657c8ba-3f30-4677-adcd-8b85ef56709b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:52.549844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657c8ba-3f30-4677-adcd-8b85ef56709b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:52.550271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657c8ba-3f30-4677-adcd-8b85ef56709b None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:52.552525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657c8ba-3f30-4677-adcd-8b85ef56709b None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:52.554933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657c8ba-3f30-4677-adcd-8b85ef56709b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:52.558757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 39/84] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:52 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:52.566019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657c8ba-3f30-4677-adcd-8b85ef56709b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:52.668108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03785c-ff03-4a1f-a39c-3d2c45c24a93 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:52.706971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:52.745003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:52.747718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:52.749358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:52.749627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:52.750949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:52.751514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:52.754330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:52.779219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 46/85] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:52.780949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:52.821409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657c8ba-3f30-4677-adcd-8b85ef56709b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:52.903735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d701be-407e-4ccf-87d6-08e61348780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:52.905712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d701be-407e-4ccf-87d6-08e61348780c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:52.906484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d701be-407e-4ccf-87d6-08e61348780c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:52.907553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d701be-407e-4ccf-87d6-08e61348780c None admin] PATH_INFO: `/v3/users/53ef2f00d00d49c8b7371a64b8d190ca` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:52.911126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d701be-407e-4ccf-87d6-08e61348780c None admin] RBAC: Authorizing `identity:get_user(user_id=53ef2f00d00d49c8b7371a64b8d190ca)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:52.915493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d701be-407e-4ccf-87d6-08e61348780c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:52.919189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 40/86] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:52 2022] GET /identity/v3/users/53ef2f00d00d49c8b7371a64b8d190ca => generated 247 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:52.920878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d701be-407e-4ccf-87d6-08e61348780c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:53.001371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f2706-2da4-41b1-b6cd-2020c91a7b07 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:53.004863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:53.077660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:53.078678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:53.079167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:53.080062 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:53.081583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] RBAC: Adding query filter params (role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=45aad056179f46b1ae71599644f97241, user.id=ea3ca793c4d044f6aa170e6369215a53) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:53.082161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:53.085473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:53.096922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 47/87] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:15:52 2022] GET /identity/v3/role_assignments?user.id=ea3ca793c4d044f6aa170e6369215a53&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:53.098991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:53.165100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d701be-407e-4ccf-87d6-08e61348780c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:53.242567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3059d9-54ba-4e77-8a14-e59464f4418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:53.244093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3059d9-54ba-4e77-8a14-e59464f4418c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:53.244906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3059d9-54ba-4e77-8a14-e59464f4418c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:53.247330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3059d9-54ba-4e77-8a14-e59464f4418c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:53.288905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:53.415080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3059d9-54ba-4e77-8a14-e59464f4418c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:53.418572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3059d9-54ba-4e77-8a14-e59464f4418c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:53.476900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:53.524935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31093-5b6d-47b2-9b47-0d12451dc4d7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:53.591171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 41/88] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:15:53.592250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3059d9-54ba-4e77-8a14-e59464f4418c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:53.628841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d20a1-00dd-44fd-8045-75bb723d20ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:53.629987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d20a1-00dd-44fd-8045-75bb723d20ae None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:53.630477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d20a1-00dd-44fd-8045-75bb723d20ae None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:53.630946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d20a1-00dd-44fd-8045-75bb723d20ae None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:53.633167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d20a1-00dd-44fd-8045-75bb723d20ae None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:53.635942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d20a1-00dd-44fd-8045-75bb723d20ae None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:53.639107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 48/89] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:53 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 542 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:53.640619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d20a1-00dd-44fd-8045-75bb723d20ae None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:53.753850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3059d9-54ba-4e77-8a14-e59464f4418c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:53.797147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:53.822488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eeb1ac-fc13-47ea-a3c2-51643526114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:53.823161 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeb1ac-fc13-47ea-a3c2-51643526114b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:53.823397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeb1ac-fc13-47ea-a3c2-51643526114b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:53.823670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeb1ac-fc13-47ea-a3c2-51643526114b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:53.837994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d20a1-00dd-44fd-8045-75bb723d20ae None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:53.864208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:53.909526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b155-b402-4058-bacc-063c5c44637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:53.911138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b155-b402-4058-bacc-063c5c44637b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:53.911886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b155-b402-4058-bacc-063c5c44637b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:53.912611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b155-b402-4058-bacc-063c5c44637b None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:53.915195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904b155-b402-4058-bacc-063c5c44637b None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:53.918470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904b155-b402-4058-bacc-063c5c44637b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:53.922273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 49/90] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:15:53 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:53.924235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b155-b402-4058-bacc-063c5c44637b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:53.981387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eeb1ac-fc13-47ea-a3c2-51643526114b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:53.982957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eeb1ac-fc13-47ea-a3c2-51643526114b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:54.129169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b155-b402-4058-bacc-063c5c44637b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:54.149554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 42/91] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:15:54.150723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eeb1ac-fc13-47ea-a3c2-51643526114b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:54.180339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:54.195723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5cc4d-f7d9-496c-aae3-d21a28c82692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:54.196842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5cc4d-f7d9-496c-aae3-d21a28c82692 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.197464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5cc4d-f7d9-496c-aae3-d21a28c82692 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.197887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5cc4d-f7d9-496c-aae3-d21a28c82692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.272812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eeb1ac-fc13-47ea-a3c2-51643526114b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:54.290764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:54.316604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf6086-3436-4482-9470-e2ff3841f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:54.317606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6086-3436-4482-9470-e2ff3841f559 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.318070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6086-3436-4482-9470-e2ff3841f559 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.318599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6086-3436-4482-9470-e2ff3841f559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.319544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf6086-3436-4482-9470-e2ff3841f559 None admin] RBAC: Adding query filter params (role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=45aad056179f46b1ae71599644f97241, user.id=ea3ca793c4d044f6aa170e6369215a53) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:54.320023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf6086-3436-4482-9470-e2ff3841f559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:54.321860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf6086-3436-4482-9470-e2ff3841f559 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:54.330621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 43/92] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:15:54 2022] GET /identity/v3/role_assignments?user.id=ea3ca793c4d044f6aa170e6369215a53&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=6385a2f348c0451081ccf442289790ed => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:54.331687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5cc4d-f7d9-496c-aae3-d21a28c82692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:54.332365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71dcb-57af-45dc-b298-ecb4bd20cb91 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.332963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71dcb-57af-45dc-b298-ecb4bd20cb91 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.333514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71dcb-57af-45dc-b298-ecb4bd20cb91 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.334605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5cc4d-f7d9-496c-aae3-d21a28c82692 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:54.335397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 44/93] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:54.336414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71dcb-57af-45dc-b298-ecb4bd20cb91 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:54.447226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:54.478185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71dcb-57af-45dc-b298-ecb4bd20cb91 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:54.502565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 50/94] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:15:54.503748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd6178-b94e-45a3-9903-0218150910ea None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.504102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd6178-b94e-45a3-9903-0218150910ea None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.504414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd6178-b94e-45a3-9903-0218150910ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.526202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c1fd6178-b94e-45a3-9903-0218150910ea None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:54.532436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c1fd6178-b94e-45a3-9903-0218150910ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:54.575967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17abaf-f05d-48b1-b76c-6a922b4844d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:54.576683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17abaf-f05d-48b1-b76c-6a922b4844d2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.576967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17abaf-f05d-48b1-b76c-6a922b4844d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.580338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17abaf-f05d-48b1-b76c-6a922b4844d2 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.583788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17abaf-f05d-48b1-b76c-6a922b4844d2 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:54.585476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17abaf-f05d-48b1-b76c-6a922b4844d2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:54.587573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 45/95] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:15:54 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:54.594052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17abaf-f05d-48b1-b76c-6a922b4844d2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:54.653282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 51/96] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:54.654197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd6178-b94e-45a3-9903-0218150910ea None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:54.668565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:54.858318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17abaf-f05d-48b1-b76c-6a922b4844d2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:54.872337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd6178-b94e-45a3-9903-0218150910ea None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:54.926539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e677a99-9c6c-4278-ae38-0220793269a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:54.927586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e677a99-9c6c-4278-ae38-0220793269a5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.928101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e677a99-9c6c-4278-ae38-0220793269a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.928613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e677a99-9c6c-4278-ae38-0220793269a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.929666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e677a99-9c6c-4278-ae38-0220793269a5 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=45aad056179f46b1ae71599644f97241, user.id=53ef2f00d00d49c8b7371a64b8d190ca) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:54.930415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e677a99-9c6c-4278-ae38-0220793269a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:54.932029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e677a99-9c6c-4278-ae38-0220793269a5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:54.939224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 52/97] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:15:54 2022] GET /identity/v3/role_assignments?user.id=53ef2f00d00d49c8b7371a64b8d190ca&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:54.941177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1132-61f1-4b3c-86b9-fdb4092e9c98 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.941697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1132-61f1-4b3c-86b9-fdb4092e9c98 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.942606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1132-61f1-4b3c-86b9-fdb4092e9c98 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.944361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 53/98] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:54.949282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209594d-f242-4679-b541-eee9b19624d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:54.950276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209594d-f242-4679-b541-eee9b19624d9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.950765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209594d-f242-4679-b541-eee9b19624d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.951246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209594d-f242-4679-b541-eee9b19624d9 None admin] PATH_INFO: `/v3/projects/51578e01cdac4d5b93cabc6e8547d664` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.952831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209594d-f242-4679-b541-eee9b19624d9 None admin] RBAC: Authorizing `identity:get_project(project_id=51578e01cdac4d5b93cabc6e8547d664)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:54.954647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209594d-f242-4679-b541-eee9b19624d9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:54.957293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 46/99] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:15:54 2022] GET /identity/v3/projects/51578e01cdac4d5b93cabc6e8547d664 => generated 312 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:54.967002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabaca7-27ab-4d93-9cd1-10aa86638257 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:54.967708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabaca7-27ab-4d93-9cd1-10aa86638257 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:54.968184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabaca7-27ab-4d93-9cd1-10aa86638257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:54.976974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209594d-f242-4679-b541-eee9b19624d9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:54.998847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7fabaca7-27ab-4d93-9cd1-10aa86638257 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:55.000916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7fabaca7-27ab-4d93-9cd1-10aa86638257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:55.039524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:55.155506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 54/100] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:55.156941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabaca7-27ab-4d93-9cd1-10aa86638257 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:55.161739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:55.219003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209594d-f242-4679-b541-eee9b19624d9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:55.294353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:55.297913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:55.298487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:55.299278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:55.301193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] RBAC: Adding query filter params (role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=51578e01cdac4d5b93cabc6e8547d664, user.id=ea3ca793c4d044f6aa170e6369215a53) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:55.302154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:55.303955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:55.319284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 47/101] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:15:54 2022] GET /identity/v3/role_assignments?user.id=ea3ca793c4d044f6aa170e6369215a53&scope.project.id=51578e01cdac4d5b93cabc6e8547d664&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 259 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:55.368109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabaca7-27ab-4d93-9cd1-10aa86638257 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:55.432724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a92ce3-bf84-43a7-9cd9-ef700f92aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:55.433129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a92ce3-bf84-43a7-9cd9-ef700f92aa03 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:55.433400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a92ce3-bf84-43a7-9cd9-ef700f92aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:55.433714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a92ce3-bf84-43a7-9cd9-ef700f92aa03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:55.453496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a92ce3-bf84-43a7-9cd9-ef700f92aa03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-91a92ce3-bf84-43a7-9cd9-ef700f92aa03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:55.458840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:55.460493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:55.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 55/102] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:15:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:55.467963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:55.595508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a92ce3-bf84-43a7-9cd9-ef700f92aa03 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:55.735816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:55.753748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda28ee-4683-4311-a54e-8a409add0b14 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:55.806812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:55.833888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:55.837166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:55.838045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:55.838864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:55.840571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:55.841961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:55.844811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:55.864965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 48/103] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:15:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:55.871967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:55.916231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a92ce3-bf84-43a7-9cd9-ef700f92aa03 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:56.042008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15655fe-b15f-4292-a873-42c62f9d3361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:56.042565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15655fe-b15f-4292-a873-42c62f9d3361 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:56.042847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15655fe-b15f-4292-a873-42c62f9d3361 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:56.043121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15655fe-b15f-4292-a873-42c62f9d3361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:56.044373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15655fe-b15f-4292-a873-42c62f9d3361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:56.045910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15655fe-b15f-4292-a873-42c62f9d3361 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:56.052316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 56/104] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:15:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:15:56.053708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15655fe-b15f-4292-a873-42c62f9d3361 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:56.178860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6c9b5-6802-4c42-a884-df49b74a2b9e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:56.264558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43f047-5ae0-4879-b651-4b76dd37ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:56.265631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43f047-5ae0-4879-b651-4b76dd37ffc8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:56.266117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43f047-5ae0-4879-b651-4b76dd37ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:56.266581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43f047-5ae0-4879-b651-4b76dd37ffc8 None admin] PATH_INFO: `/v3/users/c00dbe77c46f4f44a62c2af7a644b399` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:56.298227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43f047-5ae0-4879-b651-4b76dd37ffc8 None admin] RBAC: Authorizing `identity:get_user(user_id=c00dbe77c46f4f44a62c2af7a644b399)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:56.300153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43f047-5ae0-4879-b651-4b76dd37ffc8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:56.302354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 49/105] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:55 2022] GET /identity/v3/users/c00dbe77c46f4f44a62c2af7a644b399 => generated 289 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:15:56.308374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43f047-5ae0-4879-b651-4b76dd37ffc8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:56.323616 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:56.365266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15655fe-b15f-4292-a873-42c62f9d3361 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:56.482864 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:56.501930 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9f93-d3e2-40d0-bc27-3096710b5539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:56.503027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9f93-d3e2-40d0-bc27-3096710b5539 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:56.503529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9f93-d3e2-40d0-bc27-3096710b5539 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:56.504097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9f93-d3e2-40d0-bc27-3096710b5539 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:56.506339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de9f93-d3e2-40d0-bc27-3096710b5539 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:56.509311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de9f93-d3e2-40d0-bc27-3096710b5539 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:56.526766 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43f047-5ae0-4879-b651-4b76dd37ffc8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:56.621485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 57/106] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:15:56 2022] POST /identity/v3/projects => generated 302 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:15:56.629054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3881b55-010a-4d8b-ad2f-bbc5a260ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:56.630808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881b55-010a-4d8b-ad2f-bbc5a260ee70 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:56.632015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881b55-010a-4d8b-ad2f-bbc5a260ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:56.633021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881b55-010a-4d8b-ad2f-bbc5a260ee70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:56.810597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3881b55-010a-4d8b-ad2f-bbc5a260ee70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:56.814011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3881b55-010a-4d8b-ad2f-bbc5a260ee70 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:56.835804 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:57.038113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 50/107] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:15:57.047271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9f93-d3e2-40d0-bc27-3096710b5539 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:57.218988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9f93-d3e2-40d0-bc27-3096710b5539 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:57.294365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d61a51-a6ee-458c-a65a-4f0584a08128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:57.295509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d61a51-a6ee-458c-a65a-4f0584a08128 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:57.296029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d61a51-a6ee-458c-a65a-4f0584a08128 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:57.296648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d61a51-a6ee-458c-a65a-4f0584a08128 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:57.298949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d61a51-a6ee-458c-a65a-4f0584a08128 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:57.302785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d61a51-a6ee-458c-a65a-4f0584a08128 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:57.306362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 58/108] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:15:57 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:57.313239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3881b55-010a-4d8b-ad2f-bbc5a260ee70 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:57.499670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3881b55-010a-4d8b-ad2f-bbc5a260ee70 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:57.508969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:57.558949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746aa45c-3867-49c7-ac25-2101b976e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:57.559584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aa45c-3867-49c7-ac25-2101b976e1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:57.559867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aa45c-3867-49c7-ac25-2101b976e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:57.560141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aa45c-3867-49c7-ac25-2101b976e1a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:57.560964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746aa45c-3867-49c7-ac25-2101b976e1a6 None admin] RBAC: Adding query filter params (role.id=db989ea59ab4489e83c7b010c84f1b91, scope.project.id=45aad056179f46b1ae71599644f97241, user.id=c00dbe77c46f4f44a62c2af7a644b399) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:57.561446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746aa45c-3867-49c7-ac25-2101b976e1a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:57.563003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746aa45c-3867-49c7-ac25-2101b976e1a6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:57.570186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 51/109] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:15:57 2022] GET /identity/v3/role_assignments?user.id=c00dbe77c46f4f44a62c2af7a644b399&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=db989ea59ab4489e83c7b010c84f1b91 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:57.894775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a338-7487-4830-9512-9307f4c6ad42 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:57.895080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a338-7487-4830-9512-9307f4c6ad42 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:57.895537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a338-7487-4830-9512-9307f4c6ad42 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:57.897059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 59/110] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:57.905833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a68c-d896-460f-b8ef-106ab2114814 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:57.906235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a68c-d896-460f-b8ef-106ab2114814 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:57.906377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a68c-d896-460f-b8ef-106ab2114814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:57.934789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7547a68c-d896-460f-b8ef-106ab2114814 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:57.936114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7547a68c-d896-460f-b8ef-106ab2114814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:58.034859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 52/111] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:58.530089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a338-7487-4830-9512-9307f4c6ad42 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:58.603528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:58.669936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a338-7487-4830-9512-9307f4c6ad42 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:58.713417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f236d13-1500-451a-910d-724fbabe9267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:58.714100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236d13-1500-451a-910d-724fbabe9267 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:58.714386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236d13-1500-451a-910d-724fbabe9267 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:58.714667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236d13-1500-451a-910d-724fbabe9267 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:58.727552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f236d13-1500-451a-910d-724fbabe9267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-5f236d13-1500-451a-910d-724fbabe9267 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:58.733105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:58.733981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:58.735292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 60/112] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:58.741712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547a68c-d896-460f-b8ef-106ab2114814 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:58.814517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ed71-38ea-47f4-8d2b-43fb3486e460 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:58.814704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ed71-38ea-47f4-8d2b-43fb3486e460 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:58.815001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ed71-38ea-47f4-8d2b-43fb3486e460 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:58.816988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 61/113] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:58.822832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66511-c625-4cd6-8047-1b8a389cc723 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:58.823351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66511-c625-4cd6-8047-1b8a389cc723 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:58.824043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66511-c625-4cd6-8047-1b8a389cc723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:58.852502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1ce66511-c625-4cd6-8047-1b8a389cc723 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:58.860423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1ce66511-c625-4cd6-8047-1b8a389cc723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:58.958488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 62/114] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:15:58.994916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45cd0-e311-453e-8020-c81d1a1e610d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:58.995370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45cd0-e311-453e-8020-c81d1a1e610d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:58.995698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45cd0-e311-453e-8020-c81d1a1e610d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:58.998206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 63/115] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:59.018430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c00ae-760c-43d4-8b66-e600b7d5c4fc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:59.018953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c00ae-760c-43d4-8b66-e600b7d5c4fc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:59.019417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c00ae-760c-43d4-8b66-e600b7d5c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:59.049587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f99c00ae-760c-43d4-8b66-e600b7d5c4fc None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:59.052025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f99c00ae-760c-43d4-8b66-e600b7d5c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:59.096912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:59.107463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:59.112986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547a68c-d896-460f-b8ef-106ab2114814 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:59.154425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 64/116] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:15:59.232249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240176d-8fbf-415a-957e-c9c0e2024ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:59.233710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240176d-8fbf-415a-957e-c9c0e2024ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:59.234178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240176d-8fbf-415a-957e-c9c0e2024ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:59.234656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240176d-8fbf-415a-957e-c9c0e2024ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:59.235790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240176d-8fbf-415a-957e-c9c0e2024ae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:15:59.236421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240176d-8fbf-415a-957e-c9c0e2024ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:59.239240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240176d-8fbf-415a-957e-c9c0e2024ae1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:59.265226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 53/117] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:15:59.271107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c00ae-760c-43d4-8b66-e600b7d5c4fc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:59.317793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ff3b-20cb-46f9-a05f-f70285d9aabc None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:59.318405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ff3b-20cb-46f9-a05f-f70285d9aabc None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:59.318655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ff3b-20cb-46f9-a05f-f70285d9aabc None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:59.321308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 54/118] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:15:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:15:59.327939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e89a9-fb69-40a9-bfce-6028a142a6a6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:59.328413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e89a9-fb69-40a9-bfce-6028a142a6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:59.328800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e89a9-fb69-40a9-bfce-6028a142a6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:59.373103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-593e89a9-fb69-40a9-bfce-6028a142a6a6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:59.374246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-593e89a9-fb69-40a9-bfce-6028a142a6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:59.492881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c00ae-760c-43d4-8b66-e600b7d5c4fc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:59.618939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 55/119] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:15:59.620197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e89a9-fb69-40a9-bfce-6028a142a6a6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:59.620870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ca23e-d469-426e-8b44-e184ae6a8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:59.621980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ca23e-d469-426e-8b44-e184ae6a8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:59.622461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ca23e-d469-426e-8b44-e184ae6a8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:59.622929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ca23e-d469-426e-8b44-e184ae6a8ef1 None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:59.626759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ca23e-d469-426e-8b44-e184ae6a8ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:59.629772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ca23e-d469-426e-8b44-e184ae6a8ef1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:59.634298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 65/120] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:15:59 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:15:59.636553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ca23e-d469-426e-8b44-e184ae6a8ef1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:59.714404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:59.809999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ca23e-d469-426e-8b44-e184ae6a8ef1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:59.850069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:59.857724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79913890-34e5-42e0-9b92-f79105bc77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:59.858986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79913890-34e5-42e0-9b92-f79105bc77b5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:59.859914 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79913890-34e5-42e0-9b92-f79105bc77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:59.860575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79913890-34e5-42e0-9b92-f79105bc77b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:59.874513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79913890-34e5-42e0-9b92-f79105bc77b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:15:59.878768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e89a9-fb69-40a9-bfce-6028a142a6a6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-79913890-34e5-42e0-9b92-f79105bc77b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:15:59.881072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:15:59.881907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:15:59.882651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:15:59.885175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 66/121] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:15:59.887445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79913890-34e5-42e0-9b92-f79105bc77b5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:59.988447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d55dcb-aeb3-412b-8879-0ce3d196417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:59.990044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d55dcb-aeb3-412b-8879-0ce3d196417a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:59.990691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d55dcb-aeb3-412b-8879-0ce3d196417a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:59.991355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d55dcb-aeb3-412b-8879-0ce3d196417a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.026821 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d55dcb-aeb3-412b-8879-0ce3d196417a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-43d55dcb-aeb3-412b-8879-0ce3d196417a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:00.038997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:00.040591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 56/122] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:00.042281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d55dcb-aeb3-412b-8879-0ce3d196417a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:00.096883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:00.104469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79913890-34e5-42e0-9b92-f79105bc77b5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:00.171383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d55dcb-aeb3-412b-8879-0ce3d196417a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:00.175045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed353d2-dd11-459b-ad45-56065b3a6175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:00.176149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed353d2-dd11-459b-ad45-56065b3a6175 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.176765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed353d2-dd11-459b-ad45-56065b3a6175 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.177217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed353d2-dd11-459b-ad45-56065b3a6175 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.179285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed353d2-dd11-459b-ad45-56065b3a6175 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:00.182164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed353d2-dd11-459b-ad45-56065b3a6175 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:00.185586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 67/123] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:15:59 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:00.187177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed353d2-dd11-459b-ad45-56065b3a6175 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:00.216083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:00.217222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.217502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.217779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.218518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:00.218773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:00.220229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:00.229949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 57/124] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:00.235670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:00.253108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:00.343559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed353d2-dd11-459b-ad45-56065b3a6175 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:00.381742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccb68-0d19-452b-af8a-c3a8c7868150 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:00.397914 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ee83e-ce0e-479b-b8c1-9688d44d3ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:00.398749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee83e-ce0e-479b-b8c1-9688d44d3ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.399488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee83e-ce0e-479b-b8c1-9688d44d3ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.400063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee83e-ce0e-479b-b8c1-9688d44d3ad5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.416761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ee83e-ce0e-479b-b8c1-9688d44d3ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-608ee83e-ce0e-479b-b8c1-9688d44d3ad5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:00.422725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:00.424265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 68/125] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:00.426401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2513c-002d-4e71-9399-30123c1de5d1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.427720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2513c-002d-4e71-9399-30123c1de5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.427720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2513c-002d-4e71-9399-30123c1de5d1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.427942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 69/126] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:00.433125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2513c-002d-4e71-9399-30123c1de5d1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:00.438842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:00.439635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.440038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.440473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.441291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:00.441727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:00.443586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:00.456235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 58/127] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:00.457625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:00.484359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:00.563820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:00.600094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae86451-5d1f-4b7c-97d5-682bbdfeb576 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:00.607759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2513c-002d-4e71-9399-30123c1de5d1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:00.656549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8867c0-8b2b-402d-887f-8d943744ae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:00.657441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8867c0-8b2b-402d-887f-8d943744ae3d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.657771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8867c0-8b2b-402d-887f-8d943744ae3d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.658496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8867c0-8b2b-402d-887f-8d943744ae3d None admin] PATH_INFO: `/v3/users/53ef2f00d00d49c8b7371a64b8d190ca` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.660117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8867c0-8b2b-402d-887f-8d943744ae3d None admin] RBAC: Authorizing `identity:get_user(user_id=53ef2f00d00d49c8b7371a64b8d190ca)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:00.662541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8867c0-8b2b-402d-887f-8d943744ae3d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:00.669414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 59/128] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:00 2022] GET /identity/v3/users/53ef2f00d00d49c8b7371a64b8d190ca => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:00.669414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8867c0-8b2b-402d-887f-8d943744ae3d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:00.670598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48f15-1790-40db-8ac9-efd84f477520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:00.671692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48f15-1790-40db-8ac9-efd84f477520 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.672135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48f15-1790-40db-8ac9-efd84f477520 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.672611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48f15-1790-40db-8ac9-efd84f477520 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241/users/ea3ca793c4d044f6aa170e6369215a53/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.675476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48f15-1790-40db-8ac9-efd84f477520 None admin] RBAC: Authorizing `identity:create_grant(project_id=45aad056179f46b1ae71599644f97241, user_id=ea3ca793c4d044f6aa170e6369215a53, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:00.679031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48f15-1790-40db-8ac9-efd84f477520 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:00.697994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 70/129] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:00 2022] PUT /identity/v3/projects/45aad056179f46b1ae71599644f97241/users/ea3ca793c4d044f6aa170e6369215a53/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:00.700488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fc68-0e02-4a04-b5b4-04af27a1aebe None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.701214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fc68-0e02-4a04-b5b4-04af27a1aebe None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.701834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fc68-0e02-4a04-b5b4-04af27a1aebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.733454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8f92fc68-0e02-4a04-b5b4-04af27a1aebe None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:00.735538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8f92fc68-0e02-4a04-b5b4-04af27a1aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:00.830879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 71/130] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:00.836669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92fc68-0e02-4a04-b5b4-04af27a1aebe None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:00.869844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:00.895729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8867c0-8b2b-402d-887f-8d943744ae3d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:00.963903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:00.964898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:00.965362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:00.965881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:00.967031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:00.967536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:00.970249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:00.985970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 60/131] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:00.987420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:01.002953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:01.063727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92fc68-0e02-4a04-b5b4-04af27a1aebe None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:01.116801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e07c6-c198-493d-bd27-c3a6b9533b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:01.117471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e07c6-c198-493d-bd27-c3a6b9533b79 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.117750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e07c6-c198-493d-bd27-c3a6b9533b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.118027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e07c6-c198-493d-bd27-c3a6b9533b79 None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.119766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e07c6-c198-493d-bd27-c3a6b9533b79 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:01.123360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e07c6-c198-493d-bd27-c3a6b9533b79 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:01.126287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 72/132] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:00 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:01.127887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67347e-99f3-475a-9e93-99c77b161f73 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.128404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67347e-99f3-475a-9e93-99c77b161f73 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.128882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67347e-99f3-475a-9e93-99c77b161f73 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.130487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 73/133] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:01.131559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67347e-99f3-475a-9e93-99c77b161f73 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:01.188307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb8542-6e4e-4cfc-8ef9-8553070d3590 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:01.252020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51bfa-48fc-47c2-8247-0c7fffc1f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:01.252987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51bfa-48fc-47c2-8247-0c7fffc1f928 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.253420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51bfa-48fc-47c2-8247-0c7fffc1f928 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.253777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51bfa-48fc-47c2-8247-0c7fffc1f928 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.255900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c51bfa-48fc-47c2-8247-0c7fffc1f928 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:01.258479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c51bfa-48fc-47c2-8247-0c7fffc1f928 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:01.261805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 61/134] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:00 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:01.263682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f4dc-c46f-4756-95a9-1238e7b297a7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.264170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f4dc-c46f-4756-95a9-1238e7b297a7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.264672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f4dc-c46f-4756-95a9-1238e7b297a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.286539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:01.294916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bb62f4dc-c46f-4756-95a9-1238e7b297a7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:01.296414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bb62f4dc-c46f-4756-95a9-1238e7b297a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:01.313360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67347e-99f3-475a-9e93-99c77b161f73 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:01.369198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704499-48c2-4e44-a815-a3bc54d18e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:01.370112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704499-48c2-4e44-a815-a3bc54d18e83 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.370519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704499-48c2-4e44-a815-a3bc54d18e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.370943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704499-48c2-4e44-a815-a3bc54d18e83 None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.372627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21704499-48c2-4e44-a815-a3bc54d18e83 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:01.374543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21704499-48c2-4e44-a815-a3bc54d18e83 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:01.378088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 74/135] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:01 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:01.379196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704499-48c2-4e44-a815-a3bc54d18e83 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:01.409890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 62/136] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:01.410890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62f4dc-c46f-4756-95a9-1238e7b297a7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:01.418212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:01.576217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62f4dc-c46f-4756-95a9-1238e7b297a7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:01.590044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704499-48c2-4e44-a815-a3bc54d18e83 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:01.628950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2abf-d021-4214-85b9-2cff4813c943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:01.629986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2abf-d021-4214-85b9-2cff4813c943 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.629986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2abf-d021-4214-85b9-2cff4813c943 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.630231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2abf-d021-4214-85b9-2cff4813c943 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.632572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b2abf-d021-4214-85b9-2cff4813c943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:01.635632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b2abf-d021-4214-85b9-2cff4813c943 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:01.638070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 63/137] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:16:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:01.642113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2abf-d021-4214-85b9-2cff4813c943 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:01.669121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1c499-9cb4-4261-95c6-2a8c1d8e37c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:01.670215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1c499-9cb4-4261-95c6-2a8c1d8e37c5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.670704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1c499-9cb4-4261-95c6-2a8c1d8e37c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.671699 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1c499-9cb4-4261-95c6-2a8c1d8e37c5 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.678847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1c499-9cb4-4261-95c6-2a8c1d8e37c5 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:01.681982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1c499-9cb4-4261-95c6-2a8c1d8e37c5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:01.685431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 75/138] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:01 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:01.687207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1c499-9cb4-4261-95c6-2a8c1d8e37c5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:01.720825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:01.765535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:01.831917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2abf-d021-4214-85b9-2cff4813c943 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:01.833823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1c499-9cb4-4261-95c6-2a8c1d8e37c5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:01.877204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e13cd-9fb3-42d8-b06f-2b7b90ecf239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:01.878257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e13cd-9fb3-42d8-b06f-2b7b90ecf239 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.878616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e13cd-9fb3-42d8-b06f-2b7b90ecf239 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.878895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e13cd-9fb3-42d8-b06f-2b7b90ecf239 None admin] PATH_INFO: `/v3/projects/51578e01cdac4d5b93cabc6e8547d664` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.880476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e13cd-9fb3-42d8-b06f-2b7b90ecf239 None admin] RBAC: Authorizing `identity:get_project(project_id=51578e01cdac4d5b93cabc6e8547d664)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:01.881990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e13cd-9fb3-42d8-b06f-2b7b90ecf239 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:01.883966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 76/139] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:01 2022] GET /identity/v3/projects/51578e01cdac4d5b93cabc6e8547d664 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:01.884719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e13cd-9fb3-42d8-b06f-2b7b90ecf239 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:01.904482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94175e-41a8-4f69-bbb9-0ee733faa78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:01.905345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94175e-41a8-4f69-bbb9-0ee733faa78a None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:01.905693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94175e-41a8-4f69-bbb9-0ee733faa78a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:01.906025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94175e-41a8-4f69-bbb9-0ee733faa78a None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241/users/53ef2f00d00d49c8b7371a64b8d190ca/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:01.908842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94175e-41a8-4f69-bbb9-0ee733faa78a None admin] RBAC: Authorizing `identity:create_grant(project_id=45aad056179f46b1ae71599644f97241, user_id=53ef2f00d00d49c8b7371a64b8d190ca, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:01.910710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94175e-41a8-4f69-bbb9-0ee733faa78a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:01.932925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 64/140] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:01 2022] PUT /identity/v3/projects/45aad056179f46b1ae71599644f97241/users/53ef2f00d00d49c8b7371a64b8d190ca/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:01.934331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94175e-41a8-4f69-bbb9-0ee733faa78a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:02.048866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:02.063054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e13cd-9fb3-42d8-b06f-2b7b90ecf239 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:02.131324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11ce68-fac2-4447-a730-ff860f16657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:02.132013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11ce68-fac2-4447-a730-ff860f16657c None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:02.132314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11ce68-fac2-4447-a730-ff860f16657c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:02.132659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11ce68-fac2-4447-a730-ff860f16657c None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:02.134155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11ce68-fac2-4447-a730-ff860f16657c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:02.136253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11ce68-fac2-4447-a730-ff860f16657c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:02.145272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94175e-41a8-4f69-bbb9-0ee733faa78a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:02.171300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 77/141] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:16:01 2022] POST /identity/v3/users => generated 283 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:02.172673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11ce68-fac2-4447-a730-ff860f16657c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:02.210108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:02.224430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2e354-5259-40dc-88a7-2b018366d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:02.226049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e354-5259-40dc-88a7-2b018366d71f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:02.227252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e354-5259-40dc-88a7-2b018366d71f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:02.228124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e354-5259-40dc-88a7-2b018366d71f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:02.251038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2e354-5259-40dc-88a7-2b018366d71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1fe2e354-5259-40dc-88a7-2b018366d71f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:02.262971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:02.264959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:02.266740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:02.270020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 65/142] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:02.276428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2e354-5259-40dc-88a7-2b018366d71f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:02.339890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11ce68-fac2-4447-a730-ff860f16657c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:02.404471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3248519-34d5-49c1-aea9-2dd571d89c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:02.406001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248519-34d5-49c1-aea9-2dd571d89c67 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:02.406948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248519-34d5-49c1-aea9-2dd571d89c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:02.407581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3248519-34d5-49c1-aea9-2dd571d89c67 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241/users/ea3ca793c4d044f6aa170e6369215a53/roles/6385a2f348c0451081ccf442289790ed` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:02.411665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3248519-34d5-49c1-aea9-2dd571d89c67 None admin] RBAC: Authorizing `identity:create_grant(project_id=45aad056179f46b1ae71599644f97241, user_id=ea3ca793c4d044f6aa170e6369215a53, role_id=6385a2f348c0451081ccf442289790ed)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:02.414612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3248519-34d5-49c1-aea9-2dd571d89c67 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:02.441493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 78/143] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:02 2022] PUT /identity/v3/projects/45aad056179f46b1ae71599644f97241/users/ea3ca793c4d044f6aa170e6369215a53/roles/6385a2f348c0451081ccf442289790ed => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:02.443738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3248519-34d5-49c1-aea9-2dd571d89c67 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:02.466702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:02.467513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2e354-5259-40dc-88a7-2b018366d71f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:02.547189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a340f-0408-4805-8ec6-67c32b1ae7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:02.548478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a340f-0408-4805-8ec6-67c32b1ae7e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:02.548919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a340f-0408-4805-8ec6-67c32b1ae7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:02.549336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a340f-0408-4805-8ec6-67c32b1ae7e2 None admin] PATH_INFO: `/v3/projects/51578e01cdac4d5b93cabc6e8547d664/users/ea3ca793c4d044f6aa170e6369215a53/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:02.552144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a340f-0408-4805-8ec6-67c32b1ae7e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=51578e01cdac4d5b93cabc6e8547d664, user_id=ea3ca793c4d044f6aa170e6369215a53, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:02.554324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a340f-0408-4805-8ec6-67c32b1ae7e2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:02.585111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 66/144] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:02 2022] PUT /identity/v3/projects/51578e01cdac4d5b93cabc6e8547d664/users/ea3ca793c4d044f6aa170e6369215a53/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:02.712648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3248519-34d5-49c1-aea9-2dd571d89c67 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:02.787755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:02.788806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:02.789239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:02.789666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:02.790781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:02.791265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:02.793832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:02.813995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 79/145] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:02.823299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a340f-0408-4805-8ec6-67c32b1ae7e2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:02.946569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:03.052032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a340f-0408-4805-8ec6-67c32b1ae7e2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:03.119156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc8b9-4738-42d5-84f1-8fad6e099e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:03.120251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc8b9-4738-42d5-84f1-8fad6e099e45 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:03.120773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc8b9-4738-42d5-84f1-8fad6e099e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:03.121265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc8b9-4738-42d5-84f1-8fad6e099e45 None admin] PATH_INFO: `/v3/users/c00dbe77c46f4f44a62c2af7a644b399` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:03.123442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc8b9-4738-42d5-84f1-8fad6e099e45 None admin] RBAC: Authorizing `identity:get_user(user_id=c00dbe77c46f4f44a62c2af7a644b399)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:03.126377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc8b9-4738-42d5-84f1-8fad6e099e45 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:03.130564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 67/146] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:02 2022] GET /identity/v3/users/c00dbe77c46f4f44a62c2af7a644b399 => generated 289 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:03.138621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:03.288789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:03.369806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb734ad-b63e-406b-9c12-a303cd3d6821 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:03.448995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9548e01-ba73-4300-8fb7-25e1d9b16d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:03.450084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9548e01-ba73-4300-8fb7-25e1d9b16d53 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:03.450582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9548e01-ba73-4300-8fb7-25e1d9b16d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:03.451056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9548e01-ba73-4300-8fb7-25e1d9b16d53 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:03.456658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9548e01-ba73-4300-8fb7-25e1d9b16d53 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:03.459807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9548e01-ba73-4300-8fb7-25e1d9b16d53 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:03.463206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 80/147] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:03 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:03.472873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc8b9-4738-42d5-84f1-8fad6e099e45 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:03.686126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc8b9-4738-42d5-84f1-8fad6e099e45 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:03.727353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:03.754078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d05d57-f847-425b-8717-24175fd6da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:03.755302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d05d57-f847-425b-8717-24175fd6da3e None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:03.755793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d05d57-f847-425b-8717-24175fd6da3e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:03.756272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d05d57-f847-425b-8717-24175fd6da3e None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241/users/c00dbe77c46f4f44a62c2af7a644b399/roles/db989ea59ab4489e83c7b010c84f1b91` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:03.759957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d05d57-f847-425b-8717-24175fd6da3e None admin] RBAC: Authorizing `identity:create_grant(project_id=45aad056179f46b1ae71599644f97241, user_id=c00dbe77c46f4f44a62c2af7a644b399, role_id=db989ea59ab4489e83c7b010c84f1b91)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:03.762920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d05d57-f847-425b-8717-24175fd6da3e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:03.792976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 68/148] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:03 2022] PUT /identity/v3/projects/45aad056179f46b1ae71599644f97241/users/c00dbe77c46f4f44a62c2af7a644b399/roles/db989ea59ab4489e83c7b010c84f1b91 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:05.425078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b1c3-09cb-480a-896f-47a39e8d1212 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:05.425949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b1c3-09cb-480a-896f-47a39e8d1212 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:05.426113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b1c3-09cb-480a-896f-47a39e8d1212 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:05.429310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 81/149] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:05.454743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f577d6-2d7f-4325-a817-b63c9b3f6f9d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:05.455529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f577d6-2d7f-4325-a817-b63c9b3f6f9d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:05.455668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f577d6-2d7f-4325-a817-b63c9b3f6f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:05.514321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-15f577d6-2d7f-4325-a817-b63c9b3f6f9d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:05.516456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-15f577d6-2d7f-4325-a817-b63c9b3f6f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:05.697194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 69/150] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:06.714566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b1c3-09cb-480a-896f-47a39e8d1212 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:06.961652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b1c3-09cb-480a-896f-47a39e8d1212 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.038741 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7752ec8-52c7-4154-b6db-dfc4339fe139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.039850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7752ec8-52c7-4154-b6db-dfc4339fe139 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.040346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7752ec8-52c7-4154-b6db-dfc4339fe139 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.040901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7752ec8-52c7-4154-b6db-dfc4339fe139 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.046868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:07.064375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7752ec8-52c7-4154-b6db-dfc4339fe139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d7752ec8-52c7-4154-b6db-dfc4339fe139 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:07.077792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:07.079465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:07.080877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 82/151] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:07.089983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f577d6-2d7f-4325-a817-b63c9b3f6f9d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.360773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f577d6-2d7f-4325-a817-b63c9b3f6f9d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.391342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:07.445772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.446417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.446689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.446961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.447739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:07.448055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.449571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.470865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 70/152] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:07.477841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7752ec8-52c7-4154-b6db-dfc4339fe139 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.694095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7752ec8-52c7-4154-b6db-dfc4339fe139 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.753491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271f74-7219-4e0b-b3d0-732676136b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.755466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271f74-7219-4e0b-b3d0-732676136b8d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.755926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271f74-7219-4e0b-b3d0-732676136b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.756342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271f74-7219-4e0b-b3d0-732676136b8d None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:07.761399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271f74-7219-4e0b-b3d0-732676136b8d None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:07.763368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65271f74-7219-4e0b-b3d0-732676136b8d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:07.765465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 83/153] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:07.772939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:07.913021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c858a1-8b4f-4ce0-8be1-4e8afc48f6af None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:07.955216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3be26a-4ab7-40e8-b276-9d1810658874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:07.956098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3be26a-4ab7-40e8-b276-9d1810658874 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:07.956577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3be26a-4ab7-40e8-b276-9d1810658874 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:07.956986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3be26a-4ab7-40e8-b276-9d1810658874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.014198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:08.054099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3be26a-4ab7-40e8-b276-9d1810658874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:08.055676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3be26a-4ab7-40e8-b276-9d1810658874 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:08.189928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 71/154] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:08.196403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c3110-607b-44ce-9576-323c52744f3e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:08.196694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c3110-607b-44ce-9576-323c52744f3e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:08.196977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c3110-607b-44ce-9576-323c52744f3e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.198512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 84/155] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:08.199586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3be26a-4ab7-40e8-b276-9d1810658874 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:08.206888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b916e-7f21-4347-9c68-cdbab716c0da None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:08.207097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b916e-7f21-4347-9c68-cdbab716c0da None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:08.207406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b916e-7f21-4347-9c68-cdbab716c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.245614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d33b916e-7f21-4347-9c68-cdbab716c0da None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:08.247271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d33b916e-7f21-4347-9c68-cdbab716c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:08.388794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:08.420538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:08.442101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 85/156] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:08.444065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e2877-3735-421c-b1c4-60c89673577d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:08.448844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e2877-3735-421c-b1c4-60c89673577d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:08.449476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e2877-3735-421c-b1c4-60c89673577d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.451272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 86/157] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:08.462533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcfad-7934-4c03-bb56-31f3bd2c6099 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:08.463159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcfad-7934-4c03-bb56-31f3bd2c6099 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:08.463733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcfad-7934-4c03-bb56-31f3bd2c6099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.487497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3be26a-4ab7-40e8-b276-9d1810658874 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:08.502999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fcedcfad-7934-4c03-bb56-31f3bd2c6099 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:08.505239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fcedcfad-7934-4c03-bb56-31f3bd2c6099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:08.614283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3103eb-e3df-4f09-89d4-17818332ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:08.615325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3103eb-e3df-4f09-89d4-17818332ac69 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:08.615748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3103eb-e3df-4f09-89d4-17818332ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:08.616174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3103eb-e3df-4f09-89d4-17818332ac69 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.618348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3103eb-e3df-4f09-89d4-17818332ac69 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:08.628914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3103eb-e3df-4f09-89d4-17818332ac69 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:08.632431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 72/159] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:08 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:08.632666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 87/159] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:08.646559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedcfad-7934-4c03-bb56-31f3bd2c6099 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:08.791146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedcfad-7934-4c03-bb56-31f3bd2c6099 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:08.832152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:08.861459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04db2ac-29b5-4023-9e4e-2985ade74c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:08.862551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04db2ac-29b5-4023-9e4e-2985ade74c66 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:08.862957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04db2ac-29b5-4023-9e4e-2985ade74c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:08.863408 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04db2ac-29b5-4023-9e4e-2985ade74c66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.865255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04db2ac-29b5-4023-9e4e-2985ade74c66 None admin] RBAC: Adding query filter params (role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=45aad056179f46b1ae71599644f97241, user.id=ea3ca793c4d044f6aa170e6369215a53) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:08.866153 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04db2ac-29b5-4023-9e4e-2985ade74c66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:08.869263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04db2ac-29b5-4023-9e4e-2985ade74c66 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:08.882013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 88/160] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:08 2022] GET /identity/v3/role_assignments?user.id=ea3ca793c4d044f6aa170e6369215a53&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:08.907114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012fc8-e5af-4e2c-84eb-75df229aea1c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:08.907635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012fc8-e5af-4e2c-84eb-75df229aea1c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:08.908348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012fc8-e5af-4e2c-84eb-75df229aea1c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.911318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 73/161] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:08.918128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839e8bb-63e2-4606-84d5-95416f782c3b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:08.918562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839e8bb-63e2-4606-84d5-95416f782c3b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:08.919084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839e8bb-63e2-4606-84d5-95416f782c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:08.956074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1839e8bb-63e2-4606-84d5-95416f782c3b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:08.959349 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1839e8bb-63e2-4606-84d5-95416f782c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:09.112825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 89/162] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:09.280199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f62baa-51ee-45f6-96db-657280c71aa5 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:09.281824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f62baa-51ee-45f6-96db-657280c71aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:09.282616 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f62baa-51ee-45f6-96db-657280c71aa5 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:09.285655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 74/163] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:09.294700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac3fc-621a-49e6-9042-254cef4cabb4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:09.295585 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac3fc-621a-49e6-9042-254cef4cabb4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:09.296723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac3fc-621a-49e6-9042-254cef4cabb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:09.335275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-69eac3fc-621a-49e6-9042-254cef4cabb4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:09.338118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-69eac3fc-621a-49e6-9042-254cef4cabb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:09.365466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f62baa-51ee-45f6-96db-657280c71aa5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:09.526994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 90/164] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:09.533741 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eac3fc-621a-49e6-9042-254cef4cabb4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:09.618234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f62baa-51ee-45f6-96db-657280c71aa5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:09.643797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:09.702124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7764c1e-d050-4d1d-b7c1-b9b5f11c798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:09.703218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764c1e-d050-4d1d-b7c1-b9b5f11c798a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:09.703730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764c1e-d050-4d1d-b7c1-b9b5f11c798a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:09.704208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764c1e-d050-4d1d-b7c1-b9b5f11c798a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:09.721710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:09.728330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7764c1e-d050-4d1d-b7c1-b9b5f11c798a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c7764c1e-d050-4d1d-b7c1-b9b5f11c798a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:09.739879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:09.741004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:09.741770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 75/165] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:16:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:09.742414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7764c1e-d050-4d1d-b7c1-b9b5f11c798a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:09.766747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eac3fc-621a-49e6-9042-254cef4cabb4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:09.852734 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eafad-296b-4cb7-af96-233355603a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:09.853635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eafad-296b-4cb7-af96-233355603a05 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:09.853762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eafad-296b-4cb7-af96-233355603a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:09.854168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eafad-296b-4cb7-af96-233355603a05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:09.881575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2eafad-296b-4cb7-af96-233355603a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-fe2eafad-296b-4cb7-af96-233355603a05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:09.890574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:09.892236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:09.893782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:09.899516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 91/166] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:09.900539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eafad-296b-4cb7-af96-233355603a05 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:09.983250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7764c1e-d050-4d1d-b7c1-b9b5f11c798a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:10.072487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869eb69-2b09-4f01-a080-d5eafbffbee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:10.073154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869eb69-2b09-4f01-a080-d5eafbffbee8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.073440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869eb69-2b09-4f01-a080-d5eafbffbee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.073711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869eb69-2b09-4f01-a080-d5eafbffbee8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.101835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869eb69-2b09-4f01-a080-d5eafbffbee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-2869eb69-2b09-4f01-a080-d5eafbffbee8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:10.111927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:10.113759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:10.115253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:10.116339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 76/167] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:10.121921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869eb69-2b09-4f01-a080-d5eafbffbee8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:10.124712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eafad-296b-4cb7-af96-233355603a05 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:10.152153 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:10.203930 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508942-b836-4ba5-ab47-a1056e015fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:10.205206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508942-b836-4ba5-ab47-a1056e015fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.205740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508942-b836-4ba5-ab47-a1056e015fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.206256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508942-b836-4ba5-ab47-a1056e015fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.207723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508942-b836-4ba5-ab47-a1056e015fd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:10.208307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508942-b836-4ba5-ab47-a1056e015fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:10.211562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508942-b836-4ba5-ab47-a1056e015fd5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:10.224588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 92/168] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:10.226413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eba0ab-ab06-4359-946a-957a3eaaa58c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.227078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eba0ab-ab06-4359-946a-957a3eaaa58c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.228482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eba0ab-ab06-4359-946a-957a3eaaa58c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.230434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 93/169] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:10.232871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eba0ab-ab06-4359-946a-957a3eaaa58c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:10.279676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:10.367879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869eb69-2b09-4f01-a080-d5eafbffbee8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:10.368533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eba0ab-ab06-4359-946a-957a3eaaa58c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:10.412469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343f6a4-8d72-40ef-8cd7-6569ffb3fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:10.413175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f6a4-8d72-40ef-8cd7-6569ffb3fe45 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.413467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f6a4-8d72-40ef-8cd7-6569ffb3fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.413816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f6a4-8d72-40ef-8cd7-6569ffb3fe45 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.414524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343f6a4-8d72-40ef-8cd7-6569ffb3fe45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:10.414888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343f6a4-8d72-40ef-8cd7-6569ffb3fe45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:10.416430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343f6a4-8d72-40ef-8cd7-6569ffb3fe45 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:10.426698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 94/170] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:10.428129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94352c-0765-47fb-b940-acbf8481255b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.428581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94352c-0765-47fb-b940-acbf8481255b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.428762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94352c-0765-47fb-b940-acbf8481255b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.430514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 95/171] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:10.431066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94352c-0765-47fb-b940-acbf8481255b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:10.433594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ab07-c40c-41d5-9fb2-e682d5a3662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:10.434797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ab07-c40c-41d5-9fb2-e682d5a3662b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.435248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ab07-c40c-41d5-9fb2-e682d5a3662b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.435697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ab07-c40c-41d5-9fb2-e682d5a3662b None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.437018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ab07-c40c-41d5-9fb2-e682d5a3662b None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:10.437536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ab07-c40c-41d5-9fb2-e682d5a3662b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:10.440086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ab07-c40c-41d5-9fb2-e682d5a3662b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:10.456915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 77/172] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:10.460062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb595-f4bb-4b49-90ab-8b6e51f25073 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.460548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb595-f4bb-4b49-90ab-8b6e51f25073 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.460980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb595-f4bb-4b49-90ab-8b6e51f25073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.478975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:10.493121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7bebb595-f4bb-4b49-90ab-8b6e51f25073 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:10.495206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7bebb595-f4bb-4b49-90ab-8b6e51f25073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:10.576291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94352c-0765-47fb-b940-acbf8481255b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:10.601778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 78/173] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:10.603136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0772-75f4-4947-93b5-270d6d4bc072 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.603422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0772-75f4-4947-93b5-270d6d4bc072 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.603693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0772-75f4-4947-93b5-270d6d4bc072 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.605139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 79/174] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:10.605910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec0772-75f4-4947-93b5-270d6d4bc072 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:10.655854 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a1f1-85cc-40ef-9228-74fb87819e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:10.656927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a1f1-85cc-40ef-9228-74fb87819e45 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.657395 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a1f1-85cc-40ef-9228-74fb87819e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.657892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a1f1-85cc-40ef-9228-74fb87819e45 None admin] PATH_INFO: `/v3/users/53ef2f00d00d49c8b7371a64b8d190ca` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.660022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a1f1-85cc-40ef-9228-74fb87819e45 None admin] RBAC: Authorizing `identity:get_user(user_id=53ef2f00d00d49c8b7371a64b8d190ca)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:10.663117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a1f1-85cc-40ef-9228-74fb87819e45 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:10.670885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 96/175] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:10 2022] GET /identity/v3/users/53ef2f00d00d49c8b7371a64b8d190ca => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:10.670885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a1f1-85cc-40ef-9228-74fb87819e45 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:10.700378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:10.791444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec0772-75f4-4947-93b5-270d6d4bc072 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:10.857968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43d7fe-b6fd-4f92-a82b-a7b69ec10452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:10.859116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43d7fe-b6fd-4f92-a82b-a7b69ec10452 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.859611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43d7fe-b6fd-4f92-a82b-a7b69ec10452 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.860084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43d7fe-b6fd-4f92-a82b-a7b69ec10452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.865822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:10.872834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a1f1-85cc-40ef-9228-74fb87819e45 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:10.884977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43d7fe-b6fd-4f92-a82b-a7b69ec10452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-0d43d7fe-b6fd-4f92-a82b-a7b69ec10452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:10.890868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:10.897247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 80/176] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:10.898752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c7db-523a-4b0d-99e4-134ab6d448d7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.900430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c7db-523a-4b0d-99e4-134ab6d448d7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.900430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c7db-523a-4b0d-99e4-134ab6d448d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.926393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1e67c7db-523a-4b0d-99e4-134ab6d448d7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:10.928165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1e67c7db-523a-4b0d-99e4-134ab6d448d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:10.940917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb25a9d-65b5-4906-9aa3-b347a0250eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:10.941661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25a9d-65b5-4906-9aa3-b347a0250eda None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:10.941859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25a9d-65b5-4906-9aa3-b347a0250eda None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:10.942139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25a9d-65b5-4906-9aa3-b347a0250eda None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:10.944138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb25a9d-65b5-4906-9aa3-b347a0250eda None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:10.945783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb25a9d-65b5-4906-9aa3-b347a0250eda None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:10.948122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 97/177] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:10 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:10.949002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb25a9d-65b5-4906-9aa3-b347a0250eda None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:11.038725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 81/178] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:11.047914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca538d-22fc-4f91-8f91-cc2fa1de5b22 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:11.047914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca538d-22fc-4f91-8f91-cc2fa1de5b22 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:11.047914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca538d-22fc-4f91-8f91-cc2fa1de5b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:11.064463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-52ca538d-22fc-4f91-8f91-cc2fa1de5b22 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:11.065704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-52ca538d-22fc-4f91-8f91-cc2fa1de5b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:11.120857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:11.131265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb25a9d-65b5-4906-9aa3-b347a0250eda None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:11.176237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 82/179] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:11.177853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca538d-22fc-4f91-8f91-cc2fa1de5b22 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:11.199360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e05d7c-c8bc-4ed0-b68d-b703452de2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:11.200813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e05d7c-c8bc-4ed0-b68d-b703452de2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:11.201502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e05d7c-c8bc-4ed0-b68d-b703452de2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:11.202277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e05d7c-c8bc-4ed0-b68d-b703452de2e2 None admin] PATH_INFO: `/v3/users/ea3ca793c4d044f6aa170e6369215a53` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:11.204469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e05d7c-c8bc-4ed0-b68d-b703452de2e2 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ca793c4d044f6aa170e6369215a53)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:11.207013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e05d7c-c8bc-4ed0-b68d-b703452de2e2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:11.210474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 98/180] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:10 2022] GET /identity/v3/users/ea3ca793c4d044f6aa170e6369215a53 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:11.211971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e05d7c-c8bc-4ed0-b68d-b703452de2e2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:11.283466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:11.378245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca538d-22fc-4f91-8f91-cc2fa1de5b22 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:11.401738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e05d7c-c8bc-4ed0-b68d-b703452de2e2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:11.448260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844a45-823b-4a71-93fb-2e442c09fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:11.449071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844a45-823b-4a71-93fb-2e442c09fb86 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:11.449510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844a45-823b-4a71-93fb-2e442c09fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:11.449954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844a45-823b-4a71-93fb-2e442c09fb86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:11.477565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:11.478896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:11.479613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:11.479932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:11.480703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:11.484339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:11.484339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:11.494025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 99/181] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:11.494638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:11.533866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:11.570760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844a45-823b-4a71-93fb-2e442c09fb86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:11.572743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844a45-823b-4a71-93fb-2e442c09fb86 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:11.637729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:11.644443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e6628-265c-4b23-9a8d-adf5db0e79f4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:11.696742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9ef68-a1c9-4dfd-b4e6-9aeec335653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:11.697521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9ef68-a1c9-4dfd-b4e6-9aeec335653b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:11.697903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9ef68-a1c9-4dfd-b4e6-9aeec335653b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:11.698344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9ef68-a1c9-4dfd-b4e6-9aeec335653b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:11.715516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 83/182] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:11.717871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844a45-823b-4a71-93fb-2e442c09fb86 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:11.802220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9ef68-a1c9-4dfd-b4e6-9aeec335653b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:11.804026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9ef68-a1c9-4dfd-b4e6-9aeec335653b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:11.849486 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:11.891937 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844a45-823b-4a71-93fb-2e442c09fb86 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:11.944100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ff993-3d85-4daa-927b-f91f10a7d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:11.944923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ff993-3d85-4daa-927b-f91f10a7d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:11.945306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ff993-3d85-4daa-927b-f91f10a7d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:11.945672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ff993-3d85-4daa-927b-f91f10a7d2e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:11.958869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:11.959781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ff993-3d85-4daa-927b-f91f10a7d2e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:11.965393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 100/183] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-2b9ff993-3d85-4daa-927b-f91f10a7d2e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:11.966189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:11.967863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:11.970045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:11.972157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9ef68-a1c9-4dfd-b4e6-9aeec335653b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:11.972505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 84/184] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:11.972505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ff993-3d85-4daa-927b-f91f10a7d2e3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.101219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ff993-3d85-4daa-927b-f91f10a7d2e3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:12.128790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9ef68-a1c9-4dfd-b4e6-9aeec335653b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:12.138830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:12.145358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec43b9-5d5b-4de4-8279-dce6479ce1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:12.146061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec43b9-5d5b-4de4-8279-dce6479ce1ee None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.146333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec43b9-5d5b-4de4-8279-dce6479ce1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.146597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec43b9-5d5b-4de4-8279-dce6479ce1ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.147847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec43b9-5d5b-4de4-8279-dce6479ce1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:12.149764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec43b9-5d5b-4de4-8279-dce6479ce1ee None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:12.151437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 85/185] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:16:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:12.152291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec43b9-5d5b-4de4-8279-dce6479ce1ee None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.184445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3bd75-3938-4e48-aae2-808559444fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:12.185243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3bd75-3938-4e48-aae2-808559444fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.185524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3bd75-3938-4e48-aae2-808559444fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.185798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3bd75-3938-4e48-aae2-808559444fe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.273362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:12.279220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3bd75-3938-4e48-aae2-808559444fe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:12.282600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3bd75-3938-4e48-aae2-808559444fe7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:12.285722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec43b9-5d5b-4de4-8279-dce6479ce1ee None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:12.328140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ce3e-4139-4b71-9a4b-dc7888f7f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:12.329158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ce3e-4139-4b71-9a4b-dc7888f7f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.329592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ce3e-4139-4b71-9a4b-dc7888f7f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.330051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ce3e-4139-4b71-9a4b-dc7888f7f8b8 None admin] PATH_INFO: `/v3/users/7b8d2015889e43849d24bfc633fe1a99` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.348303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71ce3e-4139-4b71-9a4b-dc7888f7f8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=7b8d2015889e43849d24bfc633fe1a99)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:12.351282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71ce3e-4139-4b71-9a4b-dc7888f7f8b8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:12.359342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 86/186] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:12 2022] GET /identity/v3/users/7b8d2015889e43849d24bfc633fe1a99 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:12.359342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ce3e-4139-4b71-9a4b-dc7888f7f8b8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.418597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 101/187] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:12.418597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3bd75-3938-4e48-aae2-808559444fe7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.436813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:12.496793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ce3e-4139-4b71-9a4b-dc7888f7f8b8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:12.546497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546ea87-4420-45a8-a327-d7795033995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:12.547459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546ea87-4420-45a8-a327-d7795033995f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.547928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546ea87-4420-45a8-a327-d7795033995f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.548356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546ea87-4420-45a8-a327-d7795033995f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.562058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:12.568061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3bd75-3938-4e48-aae2-808559444fe7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:12.575991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546ea87-4420-45a8-a327-d7795033995f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f546ea87-4420-45a8-a327-d7795033995f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:12.581719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:12.583528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 87/188] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:12.585951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546ea87-4420-45a8-a327-d7795033995f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.625269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc36d5a-614d-41c2-9606-ad6f5059416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:12.626067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc36d5a-614d-41c2-9606-ad6f5059416e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.626399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc36d5a-614d-41c2-9606-ad6f5059416e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.626729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc36d5a-614d-41c2-9606-ad6f5059416e None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.628199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc36d5a-614d-41c2-9606-ad6f5059416e None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:12.629968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc36d5a-614d-41c2-9606-ad6f5059416e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:12.631893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 102/189] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:12 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:12.633121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc36d5a-614d-41c2-9606-ad6f5059416e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.751859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546ea87-4420-45a8-a327-d7795033995f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:12.775089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:12.794171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc36d5a-614d-41c2-9606-ad6f5059416e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:12.797843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:12.798539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.798873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.799202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.799977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:12.800445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:12.802765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:12.813377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 88/190] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:12.814795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.846997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7c3dc-9a7e-4616-8cd6-cce47b0e4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:12.848116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7c3dc-9a7e-4616-8cd6-cce47b0e4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:12.848651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7c3dc-9a7e-4616-8cd6-cce47b0e4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:12.849137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7c3dc-9a7e-4616-8cd6-cce47b0e4ea6 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:12.851028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7c3dc-9a7e-4616-8cd6-cce47b0e4ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:12.853591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7c3dc-9a7e-4616-8cd6-cce47b0e4ea6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:12.856713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 103/191] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:12 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:12.857563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7c3dc-9a7e-4616-8cd6-cce47b0e4ea6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:12.912056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:12.970670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813f343-7797-4acc-bcc3-d3de48d24ab5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.010414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7c3dc-9a7e-4616-8cd6-cce47b0e4ea6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.016581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce2eed-616b-4dec-aa0b-af8f680f2200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.017646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce2eed-616b-4dec-aa0b-af8f680f2200 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.018128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce2eed-616b-4dec-aa0b-af8f680f2200 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.018597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce2eed-616b-4dec-aa0b-af8f680f2200 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.020046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce2eed-616b-4dec-aa0b-af8f680f2200 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.022879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce2eed-616b-4dec-aa0b-af8f680f2200 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.057532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 89/192] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:16:12 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:13.058156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333acd-bd66-42fa-b901-c68d3e1053a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.058438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce2eed-616b-4dec-aa0b-af8f680f2200 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.059219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333acd-bd66-42fa-b901-c68d3e1053a7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.059682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333acd-bd66-42fa-b901-c68d3e1053a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.060112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333acd-bd66-42fa-b901-c68d3e1053a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.138588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:13.192253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333acd-bd66-42fa-b901-c68d3e1053a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.194963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333acd-bd66-42fa-b901-c68d3e1053a7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.262369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:13.269792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce2eed-616b-4dec-aa0b-af8f680f2200 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.337366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8d46d-780d-4244-9f49-96b9702b06b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.338339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d46d-780d-4244-9f49-96b9702b06b4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.338823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d46d-780d-4244-9f49-96b9702b06b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.339262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d46d-780d-4244-9f49-96b9702b06b4 None admin] PATH_INFO: `/v3/projects/51578e01cdac4d5b93cabc6e8547d664` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.341687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8d46d-780d-4244-9f49-96b9702b06b4 None admin] RBAC: Authorizing `identity:get_project(project_id=51578e01cdac4d5b93cabc6e8547d664)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.344587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8d46d-780d-4244-9f49-96b9702b06b4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.346728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 90/193] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/projects/51578e01cdac4d5b93cabc6e8547d664 => generated 312 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:13.347462 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8d46d-780d-4244-9f49-96b9702b06b4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.400518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 104/194] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:13.400518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333acd-bd66-42fa-b901-c68d3e1053a7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.543589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8d46d-780d-4244-9f49-96b9702b06b4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.548937 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:13.581692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333acd-bd66-42fa-b901-c68d3e1053a7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.592982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.593511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.594297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.594665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.595659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:13.596056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.597630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.608337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 91/195] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:13.613287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.653663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.655100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.656201 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.657026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.658709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=45aad056179f46b1ae71599644f97241, user.id=53ef2f00d00d49c8b7371a64b8d190ca) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:13.659611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.663054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.667042 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:13.678174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 105/196] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/role_assignments?user.id=53ef2f00d00d49c8b7371a64b8d190ca&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:13.680165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:13.879231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50e065-34fc-4e62-94ff-5ae84d313c79 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.893008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1d763-8e37-4b6f-bf90-e405266f1e0d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:13.946568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:13.948136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:13.948873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:13.949537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:13.951212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] RBAC: Adding query filter params (role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=45aad056179f46b1ae71599644f97241, user.id=ea3ca793c4d044f6aa170e6369215a53) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:13.951993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:13.955668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:13.968258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 106/197] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/role_assignments?user.id=ea3ca793c4d044f6aa170e6369215a53&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=6385a2f348c0451081ccf442289790ed => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:13.969714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:14.045612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655866f-c6e4-41d8-b92e-176e61e4e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:14.046626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655866f-c6e4-41d8-b92e-176e61e4e83b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:14.047074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655866f-c6e4-41d8-b92e-176e61e4e83b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:14.047506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655866f-c6e4-41d8-b92e-176e61e4e83b None admin] PATH_INFO: `/v3/users/7b8d2015889e43849d24bfc633fe1a99` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:14.053779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655866f-c6e4-41d8-b92e-176e61e4e83b None admin] RBAC: Authorizing `identity:get_user(user_id=7b8d2015889e43849d24bfc633fe1a99)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:14.056457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655866f-c6e4-41d8-b92e-176e61e4e83b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:14.059458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 92/198] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/users/7b8d2015889e43849d24bfc633fe1a99 => generated 283 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:14.060863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655866f-c6e4-41d8-b92e-176e61e4e83b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:14.099339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:14.125600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:14.203746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4d398-3ee7-478a-85d8-bdcdef6170fc None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:14.216879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655866f-c6e4-41d8-b92e-176e61e4e83b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:14.263321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35864cee-a754-4c8c-910e-549e029862a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:14.264539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864cee-a754-4c8c-910e-549e029862a8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:14.265040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864cee-a754-4c8c-910e-549e029862a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:14.265538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864cee-a754-4c8c-910e-549e029862a8 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:14.267109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35864cee-a754-4c8c-910e-549e029862a8 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:14.269320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35864cee-a754-4c8c-910e-549e029862a8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:14.271992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 93/199] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:14 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:14.273163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35864cee-a754-4c8c-910e-549e029862a8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:14.279247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:14.280337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:14.280868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:14.282711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:14.284116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] RBAC: Adding query filter params (role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=51578e01cdac4d5b93cabc6e8547d664, user.id=ea3ca793c4d044f6aa170e6369215a53) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:14.284691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:14.288439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:14.302564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 107/200] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:13 2022] GET /identity/v3/role_assignments?user.id=ea3ca793c4d044f6aa170e6369215a53&scope.project.id=51578e01cdac4d5b93cabc6e8547d664&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:14.304001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:14.414925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35864cee-a754-4c8c-910e-549e029862a8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:14.424913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:14.463676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dea9aa-7fff-4c80-b8e4-c67dd7ab03b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:14.464872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dea9aa-7fff-4c80-b8e4-c67dd7ab03b6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:14.465468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dea9aa-7fff-4c80-b8e4-c67dd7ab03b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:14.465965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dea9aa-7fff-4c80-b8e4-c67dd7ab03b6 None admin] PATH_INFO: `/v3/users/c00dbe77c46f4f44a62c2af7a644b399` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:14.467617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dea9aa-7fff-4c80-b8e4-c67dd7ab03b6 None admin] RBAC: Authorizing `identity:get_user(user_id=c00dbe77c46f4f44a62c2af7a644b399)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:14.469951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dea9aa-7fff-4c80-b8e4-c67dd7ab03b6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:14.472516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 94/201] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:14 2022] GET /identity/v3/users/c00dbe77c46f4f44a62c2af7a644b399 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:14.481787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dea9aa-7fff-4c80-b8e4-c67dd7ab03b6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:14.522023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46441d7-d74c-486e-8908-8550a045d80d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:14.603601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:14.623655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15b74-7e40-41a3-abd3-0863353b63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:14.624701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15b74-7e40-41a3-abd3-0863353b63b9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:14.625146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15b74-7e40-41a3-abd3-0863353b63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:14.625577 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15b74-7e40-41a3-abd3-0863353b63b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:14.775586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15b74-7e40-41a3-abd3-0863353b63b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:14.778359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15b74-7e40-41a3-abd3-0863353b63b9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:14.792218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dea9aa-7fff-4c80-b8e4-c67dd7ab03b6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:14.871856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:14.873014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:14.873722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:14.874222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:14.875744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f, user.id=7b8d2015889e43849d24bfc633fe1a99) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:14.876272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:14.879324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:14.892105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 95/202] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:14 2022] GET /identity/v3/role_assignments?user.id=7b8d2015889e43849d24bfc633fe1a99&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 259 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:14.895466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:14.977888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 108/203] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:14.986283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:14.987774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15b74-7e40-41a3-abd3-0863353b63b9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:15.055297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:15.137985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7a39a-11f5-47cc-9f12-ebca31bfaa39 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:15.208558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15b74-7e40-41a3-abd3-0863353b63b9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:15.215393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3851f-b6f5-4fec-b801-2eb0e2a6b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:15.216043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3851f-b6f5-4fec-b801-2eb0e2a6b25d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:15.216317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3851f-b6f5-4fec-b801-2eb0e2a6b25d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:15.216620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3851f-b6f5-4fec-b801-2eb0e2a6b25d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:15.286527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0327-c931-4932-9f7d-cea930d50663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:15.287223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0327-c931-4932-9f7d-cea930d50663 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:15.287504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0327-c931-4932-9f7d-cea930d50663 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:15.287800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0327-c931-4932-9f7d-cea930d50663 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:15.289321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e0327-c931-4932-9f7d-cea930d50663 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:15.290961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e0327-c931-4932-9f7d-cea930d50663 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:15.293212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 109/204] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:14 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:15.309986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0327-c931-4932-9f7d-cea930d50663 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:15.384585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3851f-b6f5-4fec-b801-2eb0e2a6b25d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:15.387438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3851f-b6f5-4fec-b801-2eb0e2a6b25d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:15.485651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:15.585266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:15.611677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0327-c931-4932-9f7d-cea930d50663 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:15.678246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 96/205] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:15.687303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3851f-b6f5-4fec-b801-2eb0e2a6b25d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:15.766120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:15.767233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:15.767720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:15.768209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:15.769787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] RBAC: Adding query filter params (role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f, user.id=7b8d2015889e43849d24bfc633fe1a99) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:15.770346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:15.773245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:15.808598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 110/206] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:15 2022] GET /identity/v3/role_assignments?user.id=7b8d2015889e43849d24bfc633fe1a99&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=6385a2f348c0451081ccf442289790ed => generated 259 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:16.002672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3851f-b6f5-4fec-b801-2eb0e2a6b25d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:16.057999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cafb0-8189-4c28-9c58-f2c1d4e8987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:16.058666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cafb0-8189-4c28-9c58-f2c1d4e8987c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:16.058946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cafb0-8189-4c28-9c58-f2c1d4e8987c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:16.059220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cafb0-8189-4c28-9c58-f2c1d4e8987c None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:16.061201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cafb0-8189-4c28-9c58-f2c1d4e8987c None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:16.062762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cafb0-8189-4c28-9c58-f2c1d4e8987c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:16.064607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 97/207] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:15 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:16.074971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:16.314186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52682cbc-0920-4650-a4f0-63c96a9e2955 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:16.405417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21918da0-a88d-464d-83c3-4bc33ea73b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:16.406534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21918da0-a88d-464d-83c3-4bc33ea73b18 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:16.407013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21918da0-a88d-464d-83c3-4bc33ea73b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:16.407513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21918da0-a88d-464d-83c3-4bc33ea73b18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:16.409035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21918da0-a88d-464d-83c3-4bc33ea73b18 None admin] RBAC: Adding query filter params (role.id=db989ea59ab4489e83c7b010c84f1b91, scope.project.id=45aad056179f46b1ae71599644f97241, user.id=c00dbe77c46f4f44a62c2af7a644b399) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:16.409571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21918da0-a88d-464d-83c3-4bc33ea73b18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:16.412802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21918da0-a88d-464d-83c3-4bc33ea73b18 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:16.430738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 111/208] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:16 2022] GET /identity/v3/role_assignments?user.id=c00dbe77c46f4f44a62c2af7a644b399&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=db989ea59ab4489e83c7b010c84f1b91 => generated 608 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:17.210818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03803-f6f8-41b6-849f-782a30fce031 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.212454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03803-f6f8-41b6-849f-782a30fce031 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.213212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03803-f6f8-41b6-849f-782a30fce031 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.216021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 98/209] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:17.227034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30a7d4-09b1-4db7-ba24-970c764a9f08 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.227424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30a7d4-09b1-4db7-ba24-970c764a9f08 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.227873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30a7d4-09b1-4db7-ba24-970c764a9f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.254233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-eb30a7d4-09b1-4db7-ba24-970c764a9f08 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:17.255879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-eb30a7d4-09b1-4db7-ba24-970c764a9f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:17.283620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:17.368544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 112/210] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:17.428761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845c2c-e96c-4468-a766-54a6386874e5 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.429418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845c2c-e96c-4468-a766-54a6386874e5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.429880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845c2c-e96c-4468-a766-54a6386874e5 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.431566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 99/211] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:17.442123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91d392-bfe2-473e-9aef-0dad517474e3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.442553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91d392-bfe2-473e-9aef-0dad517474e3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.443030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91d392-bfe2-473e-9aef-0dad517474e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.472827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7f91d392-bfe2-473e-9aef-0dad517474e3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:17.475458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7f91d392-bfe2-473e-9aef-0dad517474e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:17.556802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 113/212] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:17.692964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845c2c-e96c-4468-a766-54a6386874e5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.696730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:17.837255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845c2c-e96c-4468-a766-54a6386874e5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.896098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076436a1-8fc9-451c-b17e-260b05dcddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.897304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076436a1-8fc9-451c-b17e-260b05dcddf3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.897806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076436a1-8fc9-451c-b17e-260b05dcddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.898291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076436a1-8fc9-451c-b17e-260b05dcddf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.919986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076436a1-8fc9-451c-b17e-260b05dcddf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-076436a1-8fc9-451c-b17e-260b05dcddf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:17.929959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:17.930910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:17.931691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:17.932805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 100/213] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:17.939008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91d392-bfe2-473e-9aef-0dad517474e3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.942830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076436a1-8fc9-451c-b17e-260b05dcddf3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:18.034470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:18.056780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91d392-bfe2-473e-9aef-0dad517474e3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:18.074223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:18.110085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:18.111099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.111628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.112121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.113074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:18.113642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:18.115299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:18.127106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 114/214] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:18.133724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:18.161055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076436a1-8fc9-451c-b17e-260b05dcddf3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:18.240169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ae142-6dda-465f-89fa-8d2e0991e30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:18.242287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ae142-6dda-465f-89fa-8d2e0991e30a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.242978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ae142-6dda-465f-89fa-8d2e0991e30a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.243668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ae142-6dda-465f-89fa-8d2e0991e30a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.246026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ae142-6dda-465f-89fa-8d2e0991e30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:18.248943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ae142-6dda-465f-89fa-8d2e0991e30a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:18.252637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 101/215] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:18.260286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ae142-6dda-465f-89fa-8d2e0991e30a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:18.261934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5368-ea0d-4e72-9c08-6706381528d6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:18.303654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ccf57-967c-41e2-8ac5-c3dcf22fc98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:18.304783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccf57-967c-41e2-8ac5-c3dcf22fc98e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.305276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccf57-967c-41e2-8ac5-c3dcf22fc98e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.305913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccf57-967c-41e2-8ac5-c3dcf22fc98e None admin] PATH_INFO: `/v3/users/0d70620a665b4210af510477f6e214fc` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.328304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ccf57-967c-41e2-8ac5-c3dcf22fc98e None admin] RBAC: Authorizing `identity:get_user(user_id=0d70620a665b4210af510477f6e214fc)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:18.330236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ccf57-967c-41e2-8ac5-c3dcf22fc98e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:18.338075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 115/216] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:18 2022] GET /identity/v3/users/0d70620a665b4210af510477f6e214fc => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:18.340694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ccf57-967c-41e2-8ac5-c3dcf22fc98e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:18.344182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:18.399728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ae142-6dda-465f-89fa-8d2e0991e30a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:18.443553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:18.451436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaedf08-fbc3-4a6b-ba5e-258032ed7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:18.452541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaedf08-fbc3-4a6b-ba5e-258032ed7aeb None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.453072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaedf08-fbc3-4a6b-ba5e-258032ed7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.453559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaedf08-fbc3-4a6b-ba5e-258032ed7aeb None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.454610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaedf08-fbc3-4a6b-ba5e-258032ed7aeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:18.456801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaedf08-fbc3-4a6b-ba5e-258032ed7aeb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:18.493493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 102/217] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:16:18 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:18.541880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ccf57-967c-41e2-8ac5-c3dcf22fc98e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:18.581886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6c7b-d256-45f1-bf0e-e3fd59f4bc3f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.582879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6c7b-d256-45f1-bf0e-e3fd59f4bc3f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.583640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6c7b-d256-45f1-bf0e-e3fd59f4bc3f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.592424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa540ad3-c3a3-4e86-8fcc-f8059f3efdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:18.592424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa540ad3-c3a3-4e86-8fcc-f8059f3efdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.592424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa540ad3-c3a3-4e86-8fcc-f8059f3efdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.592424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa540ad3-c3a3-4e86-8fcc-f8059f3efdf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.593297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 103/218] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:18.597061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e60cb2-8396-488f-bdc0-8a4db897283a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.597561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e60cb2-8396-488f-bdc0-8a4db897283a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.598092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e60cb2-8396-488f-bdc0-8a4db897283a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.633522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-59e60cb2-8396-488f-bdc0-8a4db897283a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:18.635624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-59e60cb2-8396-488f-bdc0-8a4db897283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:18.686153 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa540ad3-c3a3-4e86-8fcc-f8059f3efdf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:18.687665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa540ad3-c3a3-4e86-8fcc-f8059f3efdf6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:18.693118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:18.808055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 104/219] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:18.827377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d968fa-e303-44da-95bf-afa124516db8 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.828331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d968fa-e303-44da-95bf-afa124516db8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.828789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d968fa-e303-44da-95bf-afa124516db8 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.831666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 105/220] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:18.839323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5c3a-e0f5-4d5f-a9d3-30119aeb049e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:18.839323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5c3a-e0f5-4d5f-a9d3-30119aeb049e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:18.839323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5c3a-e0f5-4d5f-a9d3-30119aeb049e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:18.864287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-983f5c3a-e0f5-4d5f-a9d3-30119aeb049e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:18.866554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-983f5c3a-e0f5-4d5f-a9d3-30119aeb049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:18.869386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 116/221] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:18.874077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa540ad3-c3a3-4e86-8fcc-f8059f3efdf6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:19.006799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 106/222] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:19.036635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa540ad3-c3a3-4e86-8fcc-f8059f3efdf6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:19.040282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:19.091798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfab0-8eb2-4f9a-8d62-dcda92ed5457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:19.092485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfab0-8eb2-4f9a-8d62-dcda92ed5457 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:19.092763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfab0-8eb2-4f9a-8d62-dcda92ed5457 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:19.093031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfab0-8eb2-4f9a-8d62-dcda92ed5457 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:19.094275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccfab0-8eb2-4f9a-8d62-dcda92ed5457 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:19.095795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccfab0-8eb2-4f9a-8d62-dcda92ed5457 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:19.098000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 117/223] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:18 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:19.109133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5c3a-e0f5-4d5f-a9d3-30119aeb049e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:19.167636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:19.241454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5c3a-e0f5-4d5f-a9d3-30119aeb049e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:19.289269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:19.289831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:19.290299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:19.290578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:19.291352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] RBAC: Adding query filter params (role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f, user.id=0d70620a665b4210af510477f6e214fc) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:19.291738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:19.293457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:19.300298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 107/224] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:19 2022] GET /identity/v3/role_assignments?user.id=0d70620a665b4210af510477f6e214fc&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:19.320554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfab0-8eb2-4f9a-8d62-dcda92ed5457 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:19.511886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:19.521171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfab0-8eb2-4f9a-8d62-dcda92ed5457 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:19.603472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8cf5a-c113-45d2-9e0d-628a0151b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:19.604225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cf5a-c113-45d2-9e0d-628a0151b58d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:19.604460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cf5a-c113-45d2-9e0d-628a0151b58d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:19.608417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cf5a-c113-45d2-9e0d-628a0151b58d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:19.623613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8cf5a-c113-45d2-9e0d-628a0151b58d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a3d8cf5a-c113-45d2-9e0d-628a0151b58d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:19.629220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:19.630169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:19.630954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:19.636589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 118/225] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:16:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:19.638822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8cf5a-c113-45d2-9e0d-628a0151b58d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:19.697347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:19.775071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc1e6-96a5-41d1-a8ad-462aeccfbab5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:19.801657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:19.833528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8cf5a-c113-45d2-9e0d-628a0151b58d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:19.859682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e51c55-5ebd-4873-b6df-6de578c60c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:19.860350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e51c55-5ebd-4873-b6df-6de578c60c70 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:19.860654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e51c55-5ebd-4873-b6df-6de578c60c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:19.860927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e51c55-5ebd-4873-b6df-6de578c60c70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:19.881517 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e51c55-5ebd-4873-b6df-6de578c60c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d6e51c55-5ebd-4873-b6df-6de578c60c70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:19.887561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:19.888574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:19.889354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 108/226] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:19.896988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e51c55-5ebd-4873-b6df-6de578c60c70 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:19.921365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:19.922411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:19.922926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:19.923403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:19.924342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:19.924887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:19.926620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:19.948077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 119/227] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:19.970122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:20.026822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e51c55-5ebd-4873-b6df-6de578c60c70 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:20.077171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:20.077807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.078083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.078349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.080913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:20.081219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:20.082814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:20.106926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 109/228] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:20.132196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:20.172896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:20.230765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:20.268103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd78665-70ee-4497-b94d-84f7525d04ee None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:20.283824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075d1c-68ea-4caa-9098-596067acf4cb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:20.315696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea891a-54b4-4227-bbe3-3548ad1bc6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:20.317188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea891a-54b4-4227-bbe3-3548ad1bc6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.317721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea891a-54b4-4227-bbe3-3548ad1bc6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.318128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea891a-54b4-4227-bbe3-3548ad1bc6a9 None admin] PATH_INFO: `/v3/users/7b8d2015889e43849d24bfc633fe1a99` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.319667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea891a-54b4-4227-bbe3-3548ad1bc6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=7b8d2015889e43849d24bfc633fe1a99)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:20.321544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea891a-54b4-4227-bbe3-3548ad1bc6a9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:20.324078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 110/229] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:20 2022] GET /identity/v3/users/7b8d2015889e43849d24bfc633fe1a99 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:20.330888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea891a-54b4-4227-bbe3-3548ad1bc6a9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:20.464174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:20.466663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea891a-54b4-4227-bbe3-3548ad1bc6a9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:20.473830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a7188-25c2-4cac-8686-2c8b37444d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:20.474912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a7188-25c2-4cac-8686-2c8b37444d0a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.475397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a7188-25c2-4cac-8686-2c8b37444d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.476307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a7188-25c2-4cac-8686-2c8b37444d0a None admin] PATH_INFO: `/v3/users/7b8d2015889e43849d24bfc633fe1a99` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.481781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a7188-25c2-4cac-8686-2c8b37444d0a None admin] RBAC: Authorizing `identity:get_user(user_id=7b8d2015889e43849d24bfc633fe1a99)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:20.484627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a7188-25c2-4cac-8686-2c8b37444d0a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:20.487627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 120/230] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:19 2022] GET /identity/v3/users/7b8d2015889e43849d24bfc633fe1a99 => generated 283 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:20.506133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a7188-25c2-4cac-8686-2c8b37444d0a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:20.517783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dcfc8-6cb6-4131-8c0e-02b171fce925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:20.518742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dcfc8-6cb6-4131-8c0e-02b171fce925 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.519186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dcfc8-6cb6-4131-8c0e-02b171fce925 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.519680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dcfc8-6cb6-4131-8c0e-02b171fce925 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.521267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dcfc8-6cb6-4131-8c0e-02b171fce925 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:20.524608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dcfc8-6cb6-4131-8c0e-02b171fce925 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:20.532657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 111/231] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:20 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:20.534390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dcfc8-6cb6-4131-8c0e-02b171fce925 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:20.668658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dcfc8-6cb6-4131-8c0e-02b171fce925 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:20.714735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d39f-d84a-492b-901c-22cd35b17047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:20.715965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d39f-d84a-492b-901c-22cd35b17047 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.716505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d39f-d84a-492b-901c-22cd35b17047 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.717355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d39f-d84a-492b-901c-22cd35b17047 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/users/7b8d2015889e43849d24bfc633fe1a99/roles/6385a2f348c0451081ccf442289790ed` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.719920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372d39f-d84a-492b-901c-22cd35b17047 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee1c0bcfe004ff78d3746e99b17805f, user_id=7b8d2015889e43849d24bfc633fe1a99, role_id=6385a2f348c0451081ccf442289790ed)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:20.722425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372d39f-d84a-492b-901c-22cd35b17047 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:20.744670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 112/232] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:20 2022] PUT /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/users/7b8d2015889e43849d24bfc633fe1a99/roles/6385a2f348c0451081ccf442289790ed => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:20.845444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a7188-25c2-4cac-8686-2c8b37444d0a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:20.905610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3578-777c-43ff-9690-5b3808ca5a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:20.906726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3578-777c-43ff-9690-5b3808ca5a57 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:20.907200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3578-777c-43ff-9690-5b3808ca5a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:20.907662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3578-777c-43ff-9690-5b3808ca5a57 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:20.909291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3578-777c-43ff-9690-5b3808ca5a57 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:20.912098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3578-777c-43ff-9690-5b3808ca5a57 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:20.915840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 121/233] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:20 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:20.926052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d39f-d84a-492b-901c-22cd35b17047 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:20.973817 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:21.121402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d39f-d84a-492b-901c-22cd35b17047 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:21.170972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce17bc-c4ab-4caf-be04-fafd3925e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:21.172101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce17bc-c4ab-4caf-be04-fafd3925e961 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:21.172653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce17bc-c4ab-4caf-be04-fafd3925e961 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:21.173141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce17bc-c4ab-4caf-be04-fafd3925e961 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/users/7b8d2015889e43849d24bfc633fe1a99/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:21.178402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce17bc-c4ab-4caf-be04-fafd3925e961 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee1c0bcfe004ff78d3746e99b17805f, user_id=7b8d2015889e43849d24bfc633fe1a99, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:21.181327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce17bc-c4ab-4caf-be04-fafd3925e961 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:21.213267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 113/234] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:20 2022] PUT /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/users/7b8d2015889e43849d24bfc633fe1a99/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:22.467198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb382fd-5556-4db5-b595-295918211825 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:22.468051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb382fd-5556-4db5-b595-295918211825 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:22.468051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb382fd-5556-4db5-b595-295918211825 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:22.469554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 122/235] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:22.475885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8677-7986-425d-bf2d-3ba243f9ebd5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:22.476699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8677-7986-425d-bf2d-3ba243f9ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:22.476699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8677-7986-425d-bf2d-3ba243f9ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:22.502345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fb16f-bca7-4bd5-80e9-04b32c656cad None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:22.503337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fb16f-bca7-4bd5-80e9-04b32c656cad None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:22.504174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fb16f-bca7-4bd5-80e9-04b32c656cad None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:22.507960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 123/236] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:22.512157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-479f8677-7986-425d-bf2d-3ba243f9ebd5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:22.513462 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-479f8677-7986-425d-bf2d-3ba243f9ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:22.518978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34960-0187-456a-81b9-3e67ca58de18 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:22.519955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34960-0187-456a-81b9-3e67ca58de18 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:22.520757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34960-0187-456a-81b9-3e67ca58de18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:22.568109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6cf34960-0187-456a-81b9-3e67ca58de18 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:22.573002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6cf34960-0187-456a-81b9-3e67ca58de18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:22.662997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:22.754295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 114/237] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:22.773546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117bd3a-73e6-47b2-9e9e-52579ed92043 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:22.774895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117bd3a-73e6-47b2-9e9e-52579ed92043 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:22.775632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117bd3a-73e6-47b2-9e9e-52579ed92043 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:22.779001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 115/238] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:22.788018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59d087-6d13-4272-8932-2575cd70895b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:22.789060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59d087-6d13-4272-8932-2575cd70895b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:22.789829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59d087-6d13-4272-8932-2575cd70895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:22.800292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 124/239] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:22.839797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bd59d087-6d13-4272-8932-2575cd70895b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:22.842368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bd59d087-6d13-4272-8932-2575cd70895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:22.873194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:22.991278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 116/240] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:23.123085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34960-0187-456a-81b9-3e67ca58de18 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.162211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59d087-6d13-4272-8932-2575cd70895b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.441750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34960-0187-456a-81b9-3e67ca58de18 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.517903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59d087-6d13-4272-8932-2575cd70895b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.571403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c9ac5-1ac2-4ff2-8f69-b7da79f3cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.581118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c9ac5-1ac2-4ff2-8f69-b7da79f3cee2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.587233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c9ac5-1ac2-4ff2-8f69-b7da79f3cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.588125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c9ac5-1ac2-4ff2-8f69-b7da79f3cee2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.636845 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c9ac5-1ac2-4ff2-8f69-b7da79f3cee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c01c9ac5-1ac2-4ff2-8f69-b7da79f3cee2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:23.656249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:23.657875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:23.659473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:23.664764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 125/241] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 543 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:23.666466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c9ac5-1ac2-4ff2-8f69-b7da79f3cee2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.679954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee25e8a-1cd6-424e-bf80-6100296cea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.681787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee25e8a-1cd6-424e-bf80-6100296cea2a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.682515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee25e8a-1cd6-424e-bf80-6100296cea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.683209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee25e8a-1cd6-424e-bf80-6100296cea2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.685686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee25e8a-1cd6-424e-bf80-6100296cea2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:23.688718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee25e8a-1cd6-424e-bf80-6100296cea2a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:23.692034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 117/242] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:23.693836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee25e8a-1cd6-424e-bf80-6100296cea2a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.733490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:23.747372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:23.973998 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee25e8a-1cd6-424e-bf80-6100296cea2a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.997358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c9ac5-1ac2-4ff2-8f69-b7da79f3cee2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.095526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4ba0-00fa-4166-bcde-92f1073e3f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.096192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4ba0-00fa-4166-bcde-92f1073e3f18 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.096518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4ba0-00fa-4166-bcde-92f1073e3f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.096780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4ba0-00fa-4166-bcde-92f1073e3f18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.098600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.101148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.101989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.102757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.104814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:24.105627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.109369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.110857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a4ba0-00fa-4166-bcde-92f1073e3f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f20a4ba0-00fa-4166-bcde-92f1073e3f18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:24.116054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:24.117874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 126/243] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:24.119442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4ba0-00fa-4166-bcde-92f1073e3f18 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.142102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 118/244] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:24.144660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.297202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:24.300227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:24.345423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c443a3-124d-4a1e-8cae-ffdc6b928a0e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.345750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4ba0-00fa-4166-bcde-92f1073e3f18 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.404824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233d20e-e41d-4f7a-9e9a-f8f750272c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.405764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d20e-e41d-4f7a-9e9a-f8f750272c87 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.406201 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d20e-e41d-4f7a-9e9a-f8f750272c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.406660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d20e-e41d-4f7a-9e9a-f8f750272c87 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.407994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233d20e-e41d-4f7a-9e9a-f8f750272c87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.409274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.410288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.410659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233d20e-e41d-4f7a-9e9a-f8f750272c87 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.410769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.411135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.412232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:24.412772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.415204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.434487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 119/245] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:24.434487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.457578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 127/246] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:16:24 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:24.457578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350708c-0bb1-4613-81c4-ee16d34f0855 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.457578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350708c-0bb1-4613-81c4-ee16d34f0855 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.457578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350708c-0bb1-4613-81c4-ee16d34f0855 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.457578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 128/247] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:24.458502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350708c-0bb1-4613-81c4-ee16d34f0855 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.655678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890dc8-02ec-4731-ba24-c8c049bdbb01 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.678254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350708c-0bb1-4613-81c4-ee16d34f0855 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.747333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21c1c4-f6b1-43f0-b84c-dfa2527be662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.748022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c1c4-f6b1-43f0-b84c-dfa2527be662 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.748308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c1c4-f6b1-43f0-b84c-dfa2527be662 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.748635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c1c4-f6b1-43f0-b84c-dfa2527be662 None admin] PATH_INFO: `/v3/users/0d70620a665b4210af510477f6e214fc` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.750260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21c1c4-f6b1-43f0-b84c-dfa2527be662 None admin] RBAC: Authorizing `identity:get_user(user_id=0d70620a665b4210af510477f6e214fc)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.751761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21c1c4-f6b1-43f0-b84c-dfa2527be662 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.752345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb7fdf-c8c0-4a9d-a571-5a4d7a650e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.753327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb7fdf-c8c0-4a9d-a571-5a4d7a650e75 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.753607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 120/248] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:24 2022] GET /identity/v3/users/0d70620a665b4210af510477f6e214fc => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:24.754374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb7fdf-c8c0-4a9d-a571-5a4d7a650e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.755122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dfa5d-04d2-47ea-a4b2-84f62c5e8400 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.755410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb7fdf-c8c0-4a9d-a571-5a4d7a650e75 None admin] PATH_INFO: `/v3/users/133f3b05df7043f2a4718b628405173c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.755557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dfa5d-04d2-47ea-a4b2-84f62c5e8400 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.755892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dfa5d-04d2-47ea-a4b2-84f62c5e8400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.762335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:24.777815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-962dfa5d-04d2-47ea-a4b2-84f62c5e8400 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:24.779083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-962dfa5d-04d2-47ea-a4b2-84f62c5e8400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:24.783194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb7fdf-c8c0-4a9d-a571-5a4d7a650e75 None admin] RBAC: Authorizing `identity:get_user(user_id=133f3b05df7043f2a4718b628405173c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.787569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb7fdf-c8c0-4a9d-a571-5a4d7a650e75 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.793891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 129/249] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:24 2022] GET /identity/v3/users/133f3b05df7043f2a4718b628405173c => generated 297 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:24.793891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb7fdf-c8c0-4a9d-a571-5a4d7a650e75 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.795305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:24.908894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 121/250] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:24.909803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dfa5d-04d2-47ea-a4b2-84f62c5e8400 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.991982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb7fdf-c8c0-4a9d-a571-5a4d7a650e75 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:25.074752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8599647-fddd-4d07-b827-65411db2c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:25.076531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599647-fddd-4d07-b827-65411db2c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:25.077425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599647-fddd-4d07-b827-65411db2c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:25.078168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599647-fddd-4d07-b827-65411db2c2e5 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:25.081004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8599647-fddd-4d07-b827-65411db2c2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:25.085186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8599647-fddd-4d07-b827-65411db2c2e5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:25.091052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 130/251] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:24 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:25.103076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8599647-fddd-4d07-b827-65411db2c2e5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:25.137431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dfa5d-04d2-47ea-a4b2-84f62c5e8400 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:25.206755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740062cb-7df6-43c8-b5a0-417c3981993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:25.207350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740062cb-7df6-43c8-b5a0-417c3981993a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:25.207635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740062cb-7df6-43c8-b5a0-417c3981993a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:25.207895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740062cb-7df6-43c8-b5a0-417c3981993a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:25.219761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:25.248149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:25.338941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8599647-fddd-4d07-b827-65411db2c2e5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:25.345550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740062cb-7df6-43c8-b5a0-417c3981993a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:25.347115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740062cb-7df6-43c8-b5a0-417c3981993a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:25.392632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654f416-ba30-4675-b0a2-b13bd924a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:25.393344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f416-ba30-4675-b0a2-b13bd924a38b None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:25.393628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f416-ba30-4675-b0a2-b13bd924a38b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:25.393908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f416-ba30-4675-b0a2-b13bd924a38b None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/users/0d70620a665b4210af510477f6e214fc/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:25.396724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654f416-ba30-4675-b0a2-b13bd924a38b None admin] RBAC: Authorizing `identity:create_grant(project_id=eee1c0bcfe004ff78d3746e99b17805f, user_id=0d70620a665b4210af510477f6e214fc, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:25.399405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654f416-ba30-4675-b0a2-b13bd924a38b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:25.420569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 131/252] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:25 2022] PUT /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/users/0d70620a665b4210af510477f6e214fc/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:25.421780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654f416-ba30-4675-b0a2-b13bd924a38b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:25.526976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 122/253] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:25.529376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f3a0-b92a-41c2-8fc6-8cba797d4b5e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:25.529787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f3a0-b92a-41c2-8fc6-8cba797d4b5e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:25.530186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f3a0-b92a-41c2-8fc6-8cba797d4b5e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:25.531923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 123/254] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:25.537801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f3a0-b92a-41c2-8fc6-8cba797d4b5e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:25.631750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654f416-ba30-4675-b0a2-b13bd924a38b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:25.641386 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:25.666505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:25.687506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced12d1-e297-4a99-be68-4d50b647ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:25.688847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced12d1-e297-4a99-be68-4d50b647ebee None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:25.692464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced12d1-e297-4a99-be68-4d50b647ebee None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:25.692464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced12d1-e297-4a99-be68-4d50b647ebee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:25.705743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced12d1-e297-4a99-be68-4d50b647ebee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4ced12d1-e297-4a99-be68-4d50b647ebee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:25.719604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:25.721331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:25.722883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 132/255] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:25.724882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb7ab-d58b-465c-a6f4-6e3ffa42dc2c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:25.724882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb7ab-d58b-465c-a6f4-6e3ffa42dc2c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:25.724882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb7ab-d58b-465c-a6f4-6e3ffa42dc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:25.766828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-334cb7ab-d58b-465c-a6f4-6e3ffa42dc2c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:25.768130 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-334cb7ab-d58b-465c-a6f4-6e3ffa42dc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:25.812016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f3a0-b92a-41c2-8fc6-8cba797d4b5e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:25.874905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f5914-2962-44ae-b26a-d83ba5af8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:25.876322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5914-2962-44ae-b26a-d83ba5af8669 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:25.876705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5914-2962-44ae-b26a-d83ba5af8669 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:25.876987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5914-2962-44ae-b26a-d83ba5af8669 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:25.878800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f5914-2962-44ae-b26a-d83ba5af8669 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:25.880656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f5914-2962-44ae-b26a-d83ba5af8669 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:25.883206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 124/256] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:25 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:25.884265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f5914-2962-44ae-b26a-d83ba5af8669 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:25.926467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 133/257] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:25.927644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cb7ab-d58b-465c-a6f4-6e3ffa42dc2c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:26.072210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f5914-2962-44ae-b26a-d83ba5af8669 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:26.081057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:26.114887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:26.115554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:26.115824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:26.116099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:26.116865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:26.117169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:26.119514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:26.129589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 125/258] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:26.145780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:26.149686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cb7ab-d58b-465c-a6f4-6e3ffa42dc2c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:26.169633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:26.202636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:26.203279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:26.203566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:26.203842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:26.209787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] RBAC: Adding query filter params (role.id=db989ea59ab4489e83c7b010c84f1b91, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f, user.id=133f3b05df7043f2a4718b628405173c) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:26.209787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:26.209787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:26.221207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 134/259] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:25 2022] GET /identity/v3/role_assignments?user.id=133f3b05df7043f2a4718b628405173c&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=db989ea59ab4489e83c7b010c84f1b91 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:26.350028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04187dbc-0a4b-4f93-a704-c15cbf56e16d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:26.403784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2dd24-a15b-4693-a413-cfd2bfa8bd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:26.404510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2dd24-a15b-4693-a413-cfd2bfa8bd4f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:26.404794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2dd24-a15b-4693-a413-cfd2bfa8bd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:26.405236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2dd24-a15b-4693-a413-cfd2bfa8bd4f None admin] PATH_INFO: `/v3/users/7b8d2015889e43849d24bfc633fe1a99` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:26.412758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2dd24-a15b-4693-a413-cfd2bfa8bd4f None admin] RBAC: Authorizing `identity:get_user(user_id=7b8d2015889e43849d24bfc633fe1a99)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:26.414699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2dd24-a15b-4693-a413-cfd2bfa8bd4f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:26.417445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 126/260] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:26 2022] GET /identity/v3/users/7b8d2015889e43849d24bfc633fe1a99 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:26.425988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:26.562148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa00874-206e-44bf-8b72-8aa74a389150 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:26.609485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00345fc2-2a1e-485e-83da-f4585212774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:26.610092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00345fc2-2a1e-485e-83da-f4585212774b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:26.610380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00345fc2-2a1e-485e-83da-f4585212774b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:26.610658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00345fc2-2a1e-485e-83da-f4585212774b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:26.617895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2dd24-a15b-4693-a413-cfd2bfa8bd4f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:26.714506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:26.732650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:26.790550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00345fc2-2a1e-485e-83da-f4585212774b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:26.792119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00345fc2-2a1e-485e-83da-f4585212774b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:26.916604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2dd24-a15b-4693-a413-cfd2bfa8bd4f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:26.946801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 135/261] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:26.952952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00345fc2-2a1e-485e-83da-f4585212774b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:27.014688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2893242-5499-4e8c-a3f7-444e8114daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:27.015474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893242-5499-4e8c-a3f7-444e8114daab None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:27.015830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893242-5499-4e8c-a3f7-444e8114daab None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:27.016174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893242-5499-4e8c-a3f7-444e8114daab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:27.042960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2893242-5499-4e8c-a3f7-444e8114daab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d2893242-5499-4e8c-a3f7-444e8114daab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:27.054054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:27.055179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:27.056149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:27.057853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:27.059724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 127/262] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:27.067368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2893242-5499-4e8c-a3f7-444e8114daab None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:27.101175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00345fc2-2a1e-485e-83da-f4585212774b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:27.181991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aa4b0-c414-4d0d-b085-00a2367bce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:27.182567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa4b0-c414-4d0d-b085-00a2367bce7d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:27.182851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa4b0-c414-4d0d-b085-00a2367bce7d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:27.183133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa4b0-c414-4d0d-b085-00a2367bce7d None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:27.185170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aa4b0-c414-4d0d-b085-00a2367bce7d None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:27.186851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aa4b0-c414-4d0d-b085-00a2367bce7d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:27.192900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 136/263] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:26 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:27.195525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aa4b0-c414-4d0d-b085-00a2367bce7d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:27.240229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:27.250424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2893242-5499-4e8c-a3f7-444e8114daab None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:27.297938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:27.299197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:27.299694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:27.300163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:27.301181 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:27.301754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:27.304671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:27.316117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 128/264] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:27.322454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:27.369927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aa4b0-c414-4d0d-b085-00a2367bce7d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:27.441882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7c645-a763-4ecb-b492-c54a58878f72 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:27.447208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:27.447911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:27.448202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:27.448502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:27.449334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] RBAC: Adding query filter params (role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f, user.id=7b8d2015889e43849d24bfc633fe1a99) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:27.449648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:27.451213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:27.458582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 137/265] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:27 2022] GET /identity/v3/role_assignments?user.id=7b8d2015889e43849d24bfc633fe1a99&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=6385a2f348c0451081ccf442289790ed => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:27.493461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2700-d910-41fb-a2a7-4f878eac4189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:27.494532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2700-d910-41fb-a2a7-4f878eac4189 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:27.495012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2700-d910-41fb-a2a7-4f878eac4189 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:27.495485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2700-d910-41fb-a2a7-4f878eac4189 None admin] PATH_INFO: `/v3/users/7b8d2015889e43849d24bfc633fe1a99` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:27.501441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db2700-d910-41fb-a2a7-4f878eac4189 None admin] RBAC: Authorizing `identity:get_user(user_id=7b8d2015889e43849d24bfc633fe1a99)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:27.503521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db2700-d910-41fb-a2a7-4f878eac4189 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:27.506089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 129/266] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:27 2022] GET /identity/v3/users/7b8d2015889e43849d24bfc633fe1a99 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:27.512435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:27.528013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:27.731551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768c123-7bec-42d7-a8b5-97e04f4f8f8b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:27.801959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dc48-30c5-47fe-a89d-1e7f05159ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:27.802892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc48-30c5-47fe-a89d-1e7f05159ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:27.803304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc48-30c5-47fe-a89d-1e7f05159ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:27.803708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dc48-30c5-47fe-a89d-1e7f05159ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:27.943735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0dc48-30c5-47fe-a89d-1e7f05159ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:27.946448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0dc48-30c5-47fe-a89d-1e7f05159ca8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:27.962302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:28.150610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 138/267] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:16:28.156450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2700-d910-41fb-a2a7-4f878eac4189 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:28.195590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:28.290084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2700-d910-41fb-a2a7-4f878eac4189 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:28.330974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7d77f-52fb-40a2-b7ea-de6d197d1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:28.332096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d77f-52fb-40a2-b7ea-de6d197d1326 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:28.332612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d77f-52fb-40a2-b7ea-de6d197d1326 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:28.333104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d77f-52fb-40a2-b7ea-de6d197d1326 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:28.334609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7d77f-52fb-40a2-b7ea-de6d197d1326 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:28.336353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7d77f-52fb-40a2-b7ea-de6d197d1326 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:28.338878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 130/268] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:28 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:28.346112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dc48-30c5-47fe-a89d-1e7f05159ca8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:28.572733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dc48-30c5-47fe-a89d-1e7f05159ca8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:28.592927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:28.647718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d6976-59ea-49e5-889f-c017b3ef1dd8 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:28.648368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d6976-59ea-49e5-889f-c017b3ef1dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:28.649223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d6976-59ea-49e5-889f-c017b3ef1dd8 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:28.651168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 131/269] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:16:28.657258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af9ae-4c60-40fc-b9fc-8233ce7e658e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:28.657934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af9ae-4c60-40fc-b9fc-8233ce7e658e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:28.658518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4af9ae-4c60-40fc-b9fc-8233ce7e658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:28.660762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777632-acef-4027-a5d2-88a17cf90455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:28.661696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777632-acef-4027-a5d2-88a17cf90455 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:28.662110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777632-acef-4027-a5d2-88a17cf90455 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:28.662509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777632-acef-4027-a5d2-88a17cf90455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:28.663694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777632-acef-4027-a5d2-88a17cf90455 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f, user.id=7b8d2015889e43849d24bfc633fe1a99) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:28.664218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777632-acef-4027-a5d2-88a17cf90455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:28.666566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777632-acef-4027-a5d2-88a17cf90455 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:28.678023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 139/270] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:28 2022] GET /identity/v3/role_assignments?user.id=7b8d2015889e43849d24bfc633fe1a99&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:28.680371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05b41e-806c-4497-971e-8565510e1743 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:28.680891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05b41e-806c-4497-971e-8565510e1743 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:28.681380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05b41e-806c-4497-971e-8565510e1743 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:28.683970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8c4af9ae-4c60-40fc-b9fc-8233ce7e658e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:28.684300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 140/271] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:28.686067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8c4af9ae-4c60-40fc-b9fc-8233ce7e658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:28.690251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a44eed-216b-4301-9a7a-58a2f9a51d4f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:28.690570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a44eed-216b-4301-9a7a-58a2f9a51d4f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:28.690815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a44eed-216b-4301-9a7a-58a2f9a51d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:28.712209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-94a44eed-216b-4301-9a7a-58a2f9a51d4f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:28.713553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-94a44eed-216b-4301-9a7a-58a2f9a51d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:28.787286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 132/272] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:28.814838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 141/273] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:29.127207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af9ae-4c60-40fc-b9fc-8233ce7e658e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:29.161724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:29.260411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4af9ae-4c60-40fc-b9fc-8233ce7e658e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:29.301387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a44eed-216b-4301-9a7a-58a2f9a51d4f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:29.318980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf819c-4848-41cb-8f65-79a3bf2d4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:29.319670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf819c-4848-41cb-8f65-79a3bf2d4b58 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:29.319946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf819c-4848-41cb-8f65-79a3bf2d4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:29.320220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf819c-4848-41cb-8f65-79a3bf2d4b58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:29.321860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf819c-4848-41cb-8f65-79a3bf2d4b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:29.323428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf819c-4848-41cb-8f65-79a3bf2d4b58 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:29.325578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 133/274] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:16:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:29.331821 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf819c-4848-41cb-8f65-79a3bf2d4b58 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:29.446585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:29.458176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf819c-4848-41cb-8f65-79a3bf2d4b58 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:29.470390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:29.475221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a44eed-216b-4301-9a7a-58a2f9a51d4f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:29.504537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cfd17-c033-43b3-b678-ab4ce3cdba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:29.505253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cfd17-c033-43b3-b678-ab4ce3cdba4c None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:29.505494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cfd17-c033-43b3-b678-ab4ce3cdba4c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:29.505768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cfd17-c033-43b3-b678-ab4ce3cdba4c None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:29.506561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cfd17-c033-43b3-b678-ab4ce3cdba4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:29.508165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cfd17-c033-43b3-b678-ab4ce3cdba4c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:29.523320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3a57-4de6-46d7-87b4-419c4da3fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:29.524816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3a57-4de6-46d7-87b4-419c4da3fc68 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:29.525345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3a57-4de6-46d7-87b4-419c4da3fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:29.525825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3a57-4de6-46d7-87b4-419c4da3fc68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:29.537446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 134/275] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:16:29 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:29.542160 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f3a57-4de6-46d7-87b4-419c4da3fc68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-792f3a57-4de6-46d7-87b4-419c4da3fc68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:29.547886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:29.548941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:29.549750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:29.553200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 142/276] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:29.559455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cfd17-c033-43b3-b678-ab4ce3cdba4c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:29.685273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191365f-57c8-4ba3-b8eb-c0ff92990501 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:29.685866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191365f-57c8-4ba3-b8eb-c0ff92990501 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:29.687236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191365f-57c8-4ba3-b8eb-c0ff92990501 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:29.697163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 143/277] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:29.697350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cfd17-c033-43b3-b678-ab4ce3cdba4c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:29.700681 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dad0f2-88db-49bd-8162-44cd6c198939 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:29.701185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dad0f2-88db-49bd-8162-44cd6c198939 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:29.701664 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dad0f2-88db-49bd-8162-44cd6c198939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:29.735634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-94dad0f2-88db-49bd-8162-44cd6c198939 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:29.737734 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-94dad0f2-88db-49bd-8162-44cd6c198939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:29.740417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:29.741080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:29.741357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:29.741639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:29.742342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:29.742717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:29.744297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:29.755720 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 135/278] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:29.762163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:29.783149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:29.855262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 144/279] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:29.943310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70af0e-e215-44c5-89bd-470cc65182c4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:30.013709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77f4a2-24e4-4585-85e1-1905fb06afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:30.015383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f4a2-24e4-4585-85e1-1905fb06afb3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.016159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f4a2-24e4-4585-85e1-1905fb06afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.016977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77f4a2-24e4-4585-85e1-1905fb06afb3 None admin] PATH_INFO: `/v3/users/18e8ace0412e413d8f8cb1ac02d3dc08` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.040344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77f4a2-24e4-4585-85e1-1905fb06afb3 None admin] RBAC: Authorizing `identity:get_user(user_id=18e8ace0412e413d8f8cb1ac02d3dc08)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:30.041934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77f4a2-24e4-4585-85e1-1905fb06afb3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:30.044189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 136/280] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:29 2022] GET /identity/v3/users/18e8ace0412e413d8f8cb1ac02d3dc08 => generated 293 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:30.050092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dad0f2-88db-49bd-8162-44cd6c198939 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:30.136705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77f4a2-24e4-4585-85e1-1905fb06afb3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:30.209100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:30.230807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dad0f2-88db-49bd-8162-44cd6c198939 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:30.231695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:30.277243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77f4a2-24e4-4585-85e1-1905fb06afb3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:30.317321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b0822-5654-4b6f-8ea9-d1b66df3fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:30.319128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0822-5654-4b6f-8ea9-d1b66df3fff1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.319855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0822-5654-4b6f-8ea9-d1b66df3fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.320573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0822-5654-4b6f-8ea9-d1b66df3fff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.322130 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b0822-5654-4b6f-8ea9-d1b66df3fff1 None admin] RBAC: Adding query filter params (role.id=82ff5c8680ab48edba50f88b12a0c000, user.id=18e8ace0412e413d8f8cb1ac02d3dc08, scope.system=all) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:30.322908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b0822-5654-4b6f-8ea9-d1b66df3fff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:30.323941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379d56-54c2-49b8-b6d8-97a3ade3b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:30.324660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379d56-54c2-49b8-b6d8-97a3ade3b133 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.324939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379d56-54c2-49b8-b6d8-97a3ade3b133 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.325211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379d56-54c2-49b8-b6d8-97a3ade3b133 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.332424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b0822-5654-4b6f-8ea9-d1b66df3fff1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:30.339106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83379d56-54c2-49b8-b6d8-97a3ade3b133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-83379d56-54c2-49b8-b6d8-97a3ade3b133 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:30.345046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:30.347093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:30.349005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 137/281] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:30.354583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379d56-54c2-49b8-b6d8-97a3ade3b133 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:30.357245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 145/282] 10.222.0.55 () {56 vars in 1308 bytes} [Tue Sep 13 12:16:30 2022] GET /identity/v3/role_assignments?user.id=18e8ace0412e413d8f8cb1ac02d3dc08&scope.system=all&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:30.486770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379d56-54c2-49b8-b6d8-97a3ade3b133 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:30.524257 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:30.525729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69d65-80f8-4689-a036-41752847cea1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.525932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69d65-80f8-4689-a036-41752847cea1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.526200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69d65-80f8-4689-a036-41752847cea1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.528095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 146/283] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:16:30.536300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa603-4116-486e-8213-55229b092ec2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.536742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa603-4116-486e-8213-55229b092ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.536885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa603-4116-486e-8213-55229b092ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.537110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:30.537752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.538037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.538672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.540195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:30.540535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:30.542085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:30.553746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 138/284] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:30.560182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:30.593641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b38fa603-4116-486e-8213-55229b092ec2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:30.594905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b38fa603-4116-486e-8213-55229b092ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:30.702058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf7b8d-906d-489d-b2ae-c73795c75e94 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:30.747606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f1ea4-1ba4-4a15-b08b-d574bdd510d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:30.748269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f1ea4-1ba4-4a15-b08b-d574bdd510d7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.748591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f1ea4-1ba4-4a15-b08b-d574bdd510d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.748859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f1ea4-1ba4-4a15-b08b-d574bdd510d7 None admin] PATH_INFO: `/v3/users/0d70620a665b4210af510477f6e214fc` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.750832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f1ea4-1ba4-4a15-b08b-d574bdd510d7 None admin] RBAC: Authorizing `identity:get_user(user_id=0d70620a665b4210af510477f6e214fc)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:30.752347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f1ea4-1ba4-4a15-b08b-d574bdd510d7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:30.754430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 139/285] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:30 2022] GET /identity/v3/users/0d70620a665b4210af510477f6e214fc => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:30.761011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f1ea4-1ba4-4a15-b08b-d574bdd510d7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:30.840461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:30.853234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 147/286] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:30.932255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f1ea4-1ba4-4a15-b08b-d574bdd510d7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:31.010899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef0e7-0318-42c3-8e1b-7c579319fc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:31.011928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef0e7-0318-42c3-8e1b-7c579319fc7d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:31.012427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef0e7-0318-42c3-8e1b-7c579319fc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:31.012905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef0e7-0318-42c3-8e1b-7c579319fc7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:31.179219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ef0e7-0318-42c3-8e1b-7c579319fc7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:31.182358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ef0e7-0318-42c3-8e1b-7c579319fc7d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:31.325955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:31.353261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa603-4116-486e-8213-55229b092ec2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:31.419503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 140/287] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:31.425251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef0e7-0318-42c3-8e1b-7c579319fc7d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:31.610554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:31.653858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa603-4116-486e-8213-55229b092ec2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:31.702931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef0e7-0318-42c3-8e1b-7c579319fc7d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:31.750287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d350-ebb3-453f-aac9-cb245386b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:31.752544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d350-ebb3-453f-aac9-cb245386b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:31.756816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d350-ebb3-453f-aac9-cb245386b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:31.757442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d350-ebb3-453f-aac9-cb245386b7c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:31.786654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d350-ebb3-453f-aac9-cb245386b7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7b17d350-ebb3-453f-aac9-cb245386b7c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:31.792241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:31.793235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:31.794098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:31.799052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 148/288] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:31.807358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d350-ebb3-453f-aac9-cb245386b7c1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:31.808450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922ff6b-e854-4657-8c8a-191ea890cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:31.809397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ff6b-e854-4657-8c8a-191ea890cc77 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:31.809891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ff6b-e854-4657-8c8a-191ea890cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:31.810394 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ff6b-e854-4657-8c8a-191ea890cc77 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:31.812475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922ff6b-e854-4657-8c8a-191ea890cc77 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:31.814384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922ff6b-e854-4657-8c8a-191ea890cc77 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:31.821543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 141/289] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:31 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:31.826927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922ff6b-e854-4657-8c8a-191ea890cc77 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:31.897217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:32.032998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d350-ebb3-453f-aac9-cb245386b7c1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:32.114232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:32.115498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:32.116817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:32.117315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:32.118429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:32.118944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:32.120798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:32.132319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 149/290] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:32.138980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:32.161165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:32.174604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922ff6b-e854-4657-8c8a-191ea890cc77 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:32.316158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:32.316723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:32.316987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:32.317253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:32.318091 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] RBAC: Adding query filter params (role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f, user.id=0d70620a665b4210af510477f6e214fc) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:32.318403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:32.319934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:32.344313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 142/291] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:31 2022] GET /identity/v3/role_assignments?user.id=0d70620a665b4210af510477f6e214fc&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 608 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:32.369322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3162556-4271-43bd-aa15-2ba1e81cd9ed None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:32.443805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1fe31-658d-46fd-a341-3df08ee12ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:32.445530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1fe31-658d-46fd-a341-3df08ee12ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:32.446376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1fe31-658d-46fd-a341-3df08ee12ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:32.447139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1fe31-658d-46fd-a341-3df08ee12ce5 None admin] PATH_INFO: `/v3/users/133f3b05df7043f2a4718b628405173c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:32.449841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1fe31-658d-46fd-a341-3df08ee12ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=133f3b05df7043f2a4718b628405173c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:32.453147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1fe31-658d-46fd-a341-3df08ee12ce5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:32.457128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 150/292] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:32 2022] GET /identity/v3/users/133f3b05df7043f2a4718b628405173c => generated 297 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:32.466753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:32.656811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:32.676248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bcedd-e2fc-4d39-a300-6e42452580b5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:32.744226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b17d4-2661-4ce7-b353-fbfd5d26e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:32.745717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b17d4-2661-4ce7-b353-fbfd5d26e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:32.746409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b17d4-2661-4ce7-b353-fbfd5d26e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:32.747081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b17d4-2661-4ce7-b353-fbfd5d26e9c1 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:32.749633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b17d4-2661-4ce7-b353-fbfd5d26e9c1 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:32.752603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b17d4-2661-4ce7-b353-fbfd5d26e9c1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:32.764472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 143/293] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:32 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:32.766868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1fe31-658d-46fd-a341-3df08ee12ce5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:32.920140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:32.971097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1fe31-658d-46fd-a341-3df08ee12ce5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:33.044851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01f1c7-8802-4998-8bed-fc3f21d514c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:33.045868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01f1c7-8802-4998-8bed-fc3f21d514c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.046343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01f1c7-8802-4998-8bed-fc3f21d514c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.046816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01f1c7-8802-4998-8bed-fc3f21d514c2 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/users/133f3b05df7043f2a4718b628405173c/roles/db989ea59ab4489e83c7b010c84f1b91` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.050625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01f1c7-8802-4998-8bed-fc3f21d514c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee1c0bcfe004ff78d3746e99b17805f, user_id=133f3b05df7043f2a4718b628405173c, role_id=db989ea59ab4489e83c7b010c84f1b91)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:33.053610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01f1c7-8802-4998-8bed-fc3f21d514c2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:33.080909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 151/294] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:16:32 2022] PUT /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/users/133f3b05df7043f2a4718b628405173c/roles/db989ea59ab4489e83c7b010c84f1b91 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:33.152801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe20e4-988f-4862-8836-db2228d34f4c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.153345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe20e4-988f-4862-8836-db2228d34f4c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.153828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe20e4-988f-4862-8836-db2228d34f4c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.156743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 144/295] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:33.163976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe661b9-0c2c-4cde-8b42-c944a05cbdd6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.164465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe661b9-0c2c-4cde-8b42-c944a05cbdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.164958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe661b9-0c2c-4cde-8b42-c944a05cbdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.203155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1fe661b9-0c2c-4cde-8b42-c944a05cbdd6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:33.205519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1fe661b9-0c2c-4cde-8b42-c944a05cbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:33.345393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 152/296] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:33.594463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958346-8569-44b5-b105-33fe8d52a7a0 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.595026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958346-8569-44b5-b105-33fe8d52a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.595026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958346-8569-44b5-b105-33fe8d52a7a0 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.596518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 145/297] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:33.603281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5acf3-b3ae-4951-bfcd-9af70dd76a00 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.604236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5acf3-b3ae-4951-bfcd-9af70dd76a00 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.604735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5acf3-b3ae-4951-bfcd-9af70dd76a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.617477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958346-8569-44b5-b105-33fe8d52a7a0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:33.631480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-99f5acf3-b3ae-4951-bfcd-9af70dd76a00 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:33.633610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-99f5acf3-b3ae-4951-bfcd-9af70dd76a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:33.765277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:33.786004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 153/298] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:33.835284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958346-8569-44b5-b105-33fe8d52a7a0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:33.911467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2b94-4c62-4c99-9803-e893b4ab1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:33.912605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2b94-4c62-4c99-9803-e893b4ab1941 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:33.913089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2b94-4c62-4c99-9803-e893b4ab1941 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:33.913561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2b94-4c62-4c99-9803-e893b4ab1941 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:33.936824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc2b94-4c62-4c99-9803-e893b4ab1941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-85bc2b94-4c62-4c99-9803-e893b4ab1941 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:33.945767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:33.947526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:33.949095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 146/299] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:33.958081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5acf3-b3ae-4951-bfcd-9af70dd76a00 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.166988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428df5af-6d8a-4e84-91c1-939f84978752 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.167318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428df5af-6d8a-4e84-91c1-939f84978752 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.168057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428df5af-6d8a-4e84-91c1-939f84978752 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.170345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5acf3-b3ae-4951-bfcd-9af70dd76a00 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:34.173149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 147/300] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:34.180733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1538ee6-adeb-4770-850b-0e635a607ea4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.181617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1538ee6-adeb-4770-850b-0e635a607ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.182309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1538ee6-adeb-4770-850b-0e635a607ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.213887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b1538ee6-adeb-4770-850b-0e635a607ea4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:34.216353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b1538ee6-adeb-4770-850b-0e635a607ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:34.235383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:34.236452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.236949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.237421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.238661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:34.239166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:34.241775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:34.245069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:34.258505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 154/301] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:34.267051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.344576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 148/302] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:34.344576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1538ee6-adeb-4770-850b-0e635a607ea4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.402253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:34.481097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d010-d57a-4cf2-84f3-e50f27dd8cf7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:34.523626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a92e3-0592-4d35-b825-017d94481cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:34.524941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a92e3-0592-4d35-b825-017d94481cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.525364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a92e3-0592-4d35-b825-017d94481cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.525776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a92e3-0592-4d35-b825-017d94481cc6 None admin] PATH_INFO: `/v3/users/bd21b41f3cb14f02bf476b8f8ad03bb6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.542227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1538ee6-adeb-4770-850b-0e635a607ea4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:34.543588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a92e3-0592-4d35-b825-017d94481cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=bd21b41f3cb14f02bf476b8f8ad03bb6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:34.545304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a92e3-0592-4d35-b825-017d94481cc6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:34.547303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 155/303] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:34 2022] GET /identity/v3/users/bd21b41f3cb14f02bf476b8f8ad03bb6 => generated 293 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:34.557512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a92e3-0592-4d35-b825-017d94481cc6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.609648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194b24-ff07-48bd-9c04-b68737512177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:34.610722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194b24-ff07-48bd-9c04-b68737512177 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.611166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194b24-ff07-48bd-9c04-b68737512177 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.611613 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194b24-ff07-48bd-9c04-b68737512177 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.631930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90194b24-ff07-48bd-9c04-b68737512177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-90194b24-ff07-48bd-9c04-b68737512177 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:34.642154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:34.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:34.643936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:34.644791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 149/304] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:34.654310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194b24-ff07-48bd-9c04-b68737512177 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.677179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:34.748250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a92e3-0592-4d35-b825-017d94481cc6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:34.776948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:34.808029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:34.808770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.809001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.809274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.810114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] RBAC: Adding query filter params (role.id=db989ea59ab4489e83c7b010c84f1b91, user.id=bd21b41f3cb14f02bf476b8f8ad03bb6, scope.system=all) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:34.810467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:34.811951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:34.819190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 156/305] 10.222.0.55 () {56 vars in 1308 bytes} [Tue Sep 13 12:16:34 2022] GET /identity/v3/role_assignments?user.id=bd21b41f3cb14f02bf476b8f8ad03bb6&scope.system=all&role.id=db989ea59ab4489e83c7b010c84f1b91 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:34.820106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.846529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194b24-ff07-48bd-9c04-b68737512177 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:34.896116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:34.896908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:34.897188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:34.897517 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:34.898242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:34.898548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:34.900417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:34.912802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 150/306] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:34.918864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:34.980477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50296-5899-4112-9ef1-510168f38fde None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:35.011847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:35.042343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae49a67-4f44-48e5-bc69-8ee8c3f87b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:35.044278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae49a67-4f44-48e5-bc69-8ee8c3f87b04 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:35.044818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae49a67-4f44-48e5-bc69-8ee8c3f87b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:35.045529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae49a67-4f44-48e5-bc69-8ee8c3f87b04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:35.047314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae49a67-4f44-48e5-bc69-8ee8c3f87b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:35.050013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae49a67-4f44-48e5-bc69-8ee8c3f87b04 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:35.053666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 157/307] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:16:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:35.057059 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f8f18-ba1a-412d-aa9b-d9d0132b1cd2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:35.058809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae49a67-4f44-48e5-bc69-8ee8c3f87b04 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:35.110323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97ee9-5c3e-4145-9383-d8ba4872aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:35.111152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97ee9-5c3e-4145-9383-d8ba4872aacc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:35.111489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97ee9-5c3e-4145-9383-d8ba4872aacc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:35.112328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97ee9-5c3e-4145-9383-d8ba4872aacc None admin] PATH_INFO: `/v3/users/18e8ace0412e413d8f8cb1ac02d3dc08` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:35.114087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c97ee9-5c3e-4145-9383-d8ba4872aacc None admin] RBAC: Authorizing `identity:get_user(user_id=18e8ace0412e413d8f8cb1ac02d3dc08)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:35.116184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c97ee9-5c3e-4145-9383-d8ba4872aacc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:35.122743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 151/308] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:34 2022] GET /identity/v3/users/18e8ace0412e413d8f8cb1ac02d3dc08 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:35.124841 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97ee9-5c3e-4145-9383-d8ba4872aacc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:35.128192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:35.200311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae49a67-4f44-48e5-bc69-8ee8c3f87b04 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:35.254001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685b90a-0838-47c3-ab7c-8b85951c26fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:35.255215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685b90a-0838-47c3-ab7c-8b85951c26fa None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:35.255756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685b90a-0838-47c3-ab7c-8b85951c26fa None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:35.256179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685b90a-0838-47c3-ab7c-8b85951c26fa None admin] PATH_INFO: `/v3/groups` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:35.257386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685b90a-0838-47c3-ab7c-8b85951c26fa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:35.259992 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685b90a-0838-47c3-ab7c-8b85951c26fa None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:35.265144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97ee9-5c3e-4145-9383-d8ba4872aacc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:35.290299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 158/309] 10.222.0.55 () {60 vars in 1134 bytes} [Tue Sep 13 12:16:35 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:16:35.323931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f559d-ff71-4f9b-a1e4-5d2f7d713cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:35.325110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f559d-ff71-4f9b-a1e4-5d2f7d713cf9 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:35.325612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f559d-ff71-4f9b-a1e4-5d2f7d713cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:35.326088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f559d-ff71-4f9b-a1e4-5d2f7d713cf9 None admin] PATH_INFO: `/v3/system/users/18e8ace0412e413d8f8cb1ac02d3dc08/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:35.328260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f559d-ff71-4f9b-a1e4-5d2f7d713cf9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=18e8ace0412e413d8f8cb1ac02d3dc08, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:35.330226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f559d-ff71-4f9b-a1e4-5d2f7d713cf9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:35.345272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 152/310] 10.222.0.55 () {58 vars in 1334 bytes} [Tue Sep 13 12:16:35 2022] PUT /identity/v3/system/users/18e8ace0412e413d8f8cb1ac02d3dc08/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:35.843131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b52c-41b2-4552-bb1c-f0ac149fd7da None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:35.844141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b52c-41b2-4552-bb1c-f0ac149fd7da None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:35.844688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b52c-41b2-4552-bb1c-f0ac149fd7da None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:35.846707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 159/311] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:35.852502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde410-fc0c-4722-bb55-acd9a4d9a312 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:35.853022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde410-fc0c-4722-bb55-acd9a4d9a312 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:35.853022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde410-fc0c-4722-bb55-acd9a4d9a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:35.860824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:35.879418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-acbde410-fc0c-4722-bb55-acd9a4d9a312 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:35.881406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-acbde410-fc0c-4722-bb55-acd9a4d9a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:35.964819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 153/312] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:36.239595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98b52c-41b2-4552-bb1c-f0ac149fd7da None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:36.372657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98b52c-41b2-4552-bb1c-f0ac149fd7da None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:36.381781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:36.414650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edb7b3-5f53-4b9c-806d-91cba6e6d7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:36.415319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb7b3-5f53-4b9c-806d-91cba6e6d7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:36.415602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb7b3-5f53-4b9c-806d-91cba6e6d7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:36.415885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb7b3-5f53-4b9c-806d-91cba6e6d7a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:36.428963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edb7b3-5f53-4b9c-806d-91cba6e6d7a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c0edb7b3-5f53-4b9c-806d-91cba6e6d7a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:36.434151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:36.435095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:36.435909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 160/313] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:36.443758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde410-fc0c-4722-bb55-acd9a4d9a312 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:36.563592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde410-fc0c-4722-bb55-acd9a4d9a312 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:36.600304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:36.605556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:36.606200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:36.606482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:36.606838 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:36.607634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:36.608280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:36.610028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:36.620724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 154/314] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:36.627114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edb7b3-5f53-4b9c-806d-91cba6e6d7a6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:36.750507 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edb7b3-5f53-4b9c-806d-91cba6e6d7a6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:36.791327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5ce0-2092-455e-99dd-304a288e7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:36.792005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5ce0-2092-455e-99dd-304a288e7413 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:36.792286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5ce0-2092-455e-99dd-304a288e7413 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:36.792592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5ce0-2092-455e-99dd-304a288e7413 None admin] PATH_INFO: `/v3/users/133f3b05df7043f2a4718b628405173c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:36.793889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f5ce0-2092-455e-99dd-304a288e7413 None admin] RBAC: Authorizing `identity:get_user(user_id=133f3b05df7043f2a4718b628405173c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:36.795490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f5ce0-2092-455e-99dd-304a288e7413 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:36.797616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 161/315] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:36 2022] GET /identity/v3/users/133f3b05df7043f2a4718b628405173c => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:36.805672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:36.925297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2fa51-59a2-4884-8d21-d49c09be24e1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:36.966147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7f032-8aee-4745-b488-644ea18f6952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:36.966784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7f032-8aee-4745-b488-644ea18f6952 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:36.967064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7f032-8aee-4745-b488-644ea18f6952 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:36.967335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7f032-8aee-4745-b488-644ea18f6952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:37.041009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:37.049178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7f032-8aee-4745-b488-644ea18f6952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:37.050912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7f032-8aee-4745-b488-644ea18f6952 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:37.195419 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 155/316] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:37.201880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5ce0-2092-455e-99dd-304a288e7413 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:37.244842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:37.328526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5ce0-2092-455e-99dd-304a288e7413 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:37.367490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dba16-4039-4a11-ae7c-4865d8b65fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:37.368155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dba16-4039-4a11-ae7c-4865d8b65fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:37.368498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dba16-4039-4a11-ae7c-4865d8b65fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:37.368873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dba16-4039-4a11-ae7c-4865d8b65fc8 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:37.370129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944dba16-4039-4a11-ae7c-4865d8b65fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:37.371661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944dba16-4039-4a11-ae7c-4865d8b65fc8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:37.373773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 162/317] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:37 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:37.383114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7f032-8aee-4745-b488-644ea18f6952 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:37.505158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:37.514329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7f032-8aee-4745-b488-644ea18f6952 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:37.559769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d92dae-2f5b-4929-ba91-4da4ff474097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:37.560429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d92dae-2f5b-4929-ba91-4da4ff474097 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:37.560816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d92dae-2f5b-4929-ba91-4da4ff474097 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:37.561096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d92dae-2f5b-4929-ba91-4da4ff474097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:37.561864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d92dae-2f5b-4929-ba91-4da4ff474097 None admin] RBAC: Adding query filter params (role.id=db989ea59ab4489e83c7b010c84f1b91, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f, user.id=133f3b05df7043f2a4718b628405173c) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:37.562173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d92dae-2f5b-4929-ba91-4da4ff474097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:37.563714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d92dae-2f5b-4929-ba91-4da4ff474097 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:37.573010 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 156/318] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:16:37 2022] GET /identity/v3/role_assignments?user.id=133f3b05df7043f2a4718b628405173c&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=db989ea59ab4489e83c7b010c84f1b91 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:37.762404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79067c0-f681-428b-8902-718a735ae987 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:37.762640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79067c0-f681-428b-8902-718a735ae987 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:37.763040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79067c0-f681-428b-8902-718a735ae987 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:37.764454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 163/319] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:37.771007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac15c-05a8-475b-ba76-d4b40eb2a315 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:37.771334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac15c-05a8-475b-ba76-d4b40eb2a315 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:37.771559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac15c-05a8-475b-ba76-d4b40eb2a315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:37.793262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-07fac15c-05a8-475b-ba76-d4b40eb2a315 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:37.794508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-07fac15c-05a8-475b-ba76-d4b40eb2a315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:37.888814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 157/320] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:38.156120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79067c0-f681-428b-8902-718a735ae987 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:38.285434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f7ca-44c5-42b3-8e93-e81b0a73e5b6 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:38.286226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f7ca-44c5-42b3-8e93-e81b0a73e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:38.286674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f7ca-44c5-42b3-8e93-e81b0a73e5b6 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:38.287226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79067c0-f681-428b-8902-718a735ae987 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:38.288624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 158/321] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:38.291256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:38.294685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3521-4bd7-4d6d-9d92-e3a9c4e8bfdb None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:38.295003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3521-4bd7-4d6d-9d92-e3a9c4e8bfdb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:38.295251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3521-4bd7-4d6d-9d92-e3a9c4e8bfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:38.314725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3d7f3521-4bd7-4d6d-9d92-e3a9c4e8bfdb None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:38.316111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3d7f3521-4bd7-4d6d-9d92-e3a9c4e8bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:38.335855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559d11b-b480-4357-8c4c-70b9ce5a2bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:38.336543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d11b-b480-4357-8c4c-70b9ce5a2bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:38.336823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d11b-b480-4357-8c4c-70b9ce5a2bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:38.337095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d11b-b480-4357-8c4c-70b9ce5a2bc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:38.338259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559d11b-b480-4357-8c4c-70b9ce5a2bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:38.339742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559d11b-b480-4357-8c4c-70b9ce5a2bc9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:38.342373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 164/322] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:16:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:38.342786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45a5d-2704-4044-8da5-4b5cd479ea7b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:38.343046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45a5d-2704-4044-8da5-4b5cd479ea7b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:38.343292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45a5d-2704-4044-8da5-4b5cd479ea7b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:38.344925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 165/323] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:38.349613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45a5d-2704-4044-8da5-4b5cd479ea7b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:38.427882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 159/324] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:38.430436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980818-b419-4a6b-85d9-0186f01ea50f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:38.431107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980818-b419-4a6b-85d9-0186f01ea50f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:38.431799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980818-b419-4a6b-85d9-0186f01ea50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:38.464137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-41980818-b419-4a6b-85d9-0186f01ea50f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:38.466420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-41980818-b419-4a6b-85d9-0186f01ea50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:38.480666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45a5d-2704-4044-8da5-4b5cd479ea7b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:38.485484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:38.522680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e628def-f361-42a6-84fb-7cce13e37cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:38.523356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e628def-f361-42a6-84fb-7cce13e37cfe None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:38.523626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e628def-f361-42a6-84fb-7cce13e37cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:38.524247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e628def-f361-42a6-84fb-7cce13e37cfe None admin] PATH_INFO: `/v3/groups` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:38.524947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e628def-f361-42a6-84fb-7cce13e37cfe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:38.526454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e628def-f361-42a6-84fb-7cce13e37cfe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:38.547855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 166/325] 10.222.0.55 () {60 vars in 1134 bytes} [Tue Sep 13 12:16:38 2022] POST /identity/v3/groups => generated 226 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:38.557150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 160/326] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:38.762758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e628def-f361-42a6-84fb-7cce13e37cfe None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:38.806396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:38.835508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980818-b419-4a6b-85d9-0186f01ea50f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:38.931569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e628def-f361-42a6-84fb-7cce13e37cfe None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:39.001017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1e43f-3429-438b-a73a-fc811f728b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:39.001882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1e43f-3429-438b-a73a-fc811f728b31 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.003386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1e43f-3429-438b-a73a-fc811f728b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.003386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1e43f-3429-438b-a73a-fc811f728b31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.018937 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980818-b419-4a6b-85d9-0186f01ea50f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:39.030918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1e43f-3429-438b-a73a-fc811f728b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-49b1e43f-3429-438b-a73a-fc811f728b31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:39.040976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:39.042724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:39.044012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 167/327] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:39.053305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1e43f-3429-438b-a73a-fc811f728b31 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:39.095275 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8934c5e-f87f-48a6-b7eb-f63667590f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:39.096454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8934c5e-f87f-48a6-b7eb-f63667590f03 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.096949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8934c5e-f87f-48a6-b7eb-f63667590f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.097484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8934c5e-f87f-48a6-b7eb-f63667590f03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.120634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8934c5e-f87f-48a6-b7eb-f63667590f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a8934c5e-f87f-48a6-b7eb-f63667590f03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:39.131852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:39.133728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:39.135135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 161/328] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:39.147893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8934c5e-f87f-48a6-b7eb-f63667590f03 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:39.174294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:39.249754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:39.259272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1e43f-3429-438b-a73a-fc811f728b31 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:39.308371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:39.309282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.309282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.309568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.310497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:39.310897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:39.312379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:39.336582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 168/329] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:39.339654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:39.367030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8934c5e-f87f-48a6-b7eb-f63667590f03 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:39.450201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:39.451352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.451854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.452321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.453271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:39.454080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:39.456835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:39.468856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 162/330] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:39.478953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:39.506228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f7e2-a50e-4e78-9ba3-1f57fdbab125 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:39.571427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1d83-420b-4141-835a-5bc50ea713a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:39.572164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1d83-420b-4141-835a-5bc50ea713a2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.572478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1d83-420b-4141-835a-5bc50ea713a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.572758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1d83-420b-4141-835a-5bc50ea713a2 None admin] PATH_INFO: `/v3/users/18e8ace0412e413d8f8cb1ac02d3dc08` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.576684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1d83-420b-4141-835a-5bc50ea713a2 None admin] RBAC: Authorizing `identity:get_user(user_id=18e8ace0412e413d8f8cb1ac02d3dc08)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:39.578498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1d83-420b-4141-835a-5bc50ea713a2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:39.580878 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 169/331] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:39 2022] GET /identity/v3/users/18e8ace0412e413d8f8cb1ac02d3dc08 => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:39.593007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:39.595827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1d83-420b-4141-835a-5bc50ea713a2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:39.645314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:39.653015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1291c-107c-4034-b167-5d3f6431160d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:39.719887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2302-b57b-445f-80a4-3d7b4cc1e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:39.721041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2302-b57b-445f-80a4-3d7b4cc1e23b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.721529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2302-b57b-445f-80a4-3d7b4cc1e23b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.722060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2302-b57b-445f-80a4-3d7b4cc1e23b None admin] PATH_INFO: `/v3/users/bd21b41f3cb14f02bf476b8f8ad03bb6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.724278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc2302-b57b-445f-80a4-3d7b4cc1e23b None admin] RBAC: Authorizing `identity:get_user(user_id=bd21b41f3cb14f02bf476b8f8ad03bb6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:39.727122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc2302-b57b-445f-80a4-3d7b4cc1e23b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:39.736530 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 163/332] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:39 2022] GET /identity/v3/users/bd21b41f3cb14f02bf476b8f8ad03bb6 => generated 293 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:39.740107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2302-b57b-445f-80a4-3d7b4cc1e23b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:39.840243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1d83-420b-4141-835a-5bc50ea713a2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:39.916476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe09fe6-885e-4305-bc11-1096e2a7b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:39.917525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe09fe6-885e-4305-bc11-1096e2a7b92a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.917994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe09fe6-885e-4305-bc11-1096e2a7b92a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.918484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe09fe6-885e-4305-bc11-1096e2a7b92a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.919871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe09fe6-885e-4305-bc11-1096e2a7b92a None admin] RBAC: Adding query filter params (role.id=82ff5c8680ab48edba50f88b12a0c000, user.id=18e8ace0412e413d8f8cb1ac02d3dc08, scope.system=all) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:39.920487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe09fe6-885e-4305-bc11-1096e2a7b92a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:39.923154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe09fe6-885e-4305-bc11-1096e2a7b92a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:39.948409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 170/333] 10.222.0.55 () {56 vars in 1308 bytes} [Tue Sep 13 12:16:39 2022] GET /identity/v3/role_assignments?user.id=18e8ace0412e413d8f8cb1ac02d3dc08&scope.system=all&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 510 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:39.965119 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2302-b57b-445f-80a4-3d7b4cc1e23b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:40.039989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db801-c315-474a-951a-fb231882a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:40.041505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db801-c315-474a-951a-fb231882a6a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:40.042211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db801-c315-474a-951a-fb231882a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:40.042995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db801-c315-474a-951a-fb231882a6a1 None admin] PATH_INFO: `/v3/system/users/bd21b41f3cb14f02bf476b8f8ad03bb6/roles/db989ea59ab4489e83c7b010c84f1b91` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:40.046475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018db801-c315-474a-951a-fb231882a6a1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bd21b41f3cb14f02bf476b8f8ad03bb6, role_id=db989ea59ab4489e83c7b010c84f1b91)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:40.049651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018db801-c315-474a-951a-fb231882a6a1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:40.067823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 164/334] 10.222.0.55 () {58 vars in 1334 bytes} [Tue Sep 13 12:16:39 2022] PUT /identity/v3/system/users/bd21b41f3cb14f02bf476b8f8ad03bb6/roles/db989ea59ab4489e83c7b010c84f1b91 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:42.317289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321135bd-8ef1-4a65-8e88-0c0e6812abe6 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:42.318376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321135bd-8ef1-4a65-8e88-0c0e6812abe6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:42.318875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321135bd-8ef1-4a65-8e88-0c0e6812abe6 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:42.320858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 171/335] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:42.327312 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa66e2-eee1-4aad-a963-995c3947d4f5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:42.327824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa66e2-eee1-4aad-a963-995c3947d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:42.327894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa66e2-eee1-4aad-a963-995c3947d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:42.336791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:42.357850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-56aa66e2-eee1-4aad-a963-995c3947d4f5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:42.359106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-56aa66e2-eee1-4aad-a963-995c3947d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:42.459474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 165/336] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:43.162120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321135bd-8ef1-4a65-8e88-0c0e6812abe6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:43.184505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88664fc3-c345-4ba2-9312-bccc642fada0 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:43.184928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88664fc3-c345-4ba2-9312-bccc642fada0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:43.185104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88664fc3-c345-4ba2-9312-bccc642fada0 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:43.186790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 166/337] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:43.208421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ee87e-50cb-48db-a84e-c6879a9d2c85 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:43.208421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ee87e-50cb-48db-a84e-c6879a9d2c85 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:43.208421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ee87e-50cb-48db-a84e-c6879a9d2c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:43.268429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b65ee87e-50cb-48db-a84e-c6879a9d2c85 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:43.268923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b65ee87e-50cb-48db-a84e-c6879a9d2c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:43.392368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:43.453028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321135bd-8ef1-4a65-8e88-0c0e6812abe6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:43.475037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 167/338] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:43.513785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c1f7d-2b78-4cee-87bb-a10b82452f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:43.514470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1f7d-2b78-4cee-87bb-a10b82452f7f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:43.514749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1f7d-2b78-4cee-87bb-a10b82452f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:43.515026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1f7d-2b78-4cee-87bb-a10b82452f7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:43.528833 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c1f7d-2b78-4cee-87bb-a10b82452f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2e9c1f7d-2b78-4cee-87bb-a10b82452f7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:43.535769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:43.537498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:43.539048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 172/339] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:43.546606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ee87e-50cb-48db-a84e-c6879a9d2c85 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:43.633171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:43.685214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ee87e-50cb-48db-a84e-c6879a9d2c85 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:43.729755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce87648-3010-40e8-8bfc-a67f69044b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:43.730371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87648-3010-40e8-8bfc-a67f69044b9d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:43.730633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87648-3010-40e8-8bfc-a67f69044b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:43.730919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87648-3010-40e8-8bfc-a67f69044b9d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:43.731626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87648-3010-40e8-8bfc-a67f69044b9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:43.731935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87648-3010-40e8-8bfc-a67f69044b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:43.733742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87648-3010-40e8-8bfc-a67f69044b9d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:43.744876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 168/340] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:43.751904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c1f7d-2b78-4cee-87bb-a10b82452f7f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:43.852094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631854-2a51-4172-a628-e1024457439c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:43.852762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631854-2a51-4172-a628-e1024457439c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:43.853243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631854-2a51-4172-a628-e1024457439c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:43.855216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 169/341] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:43.869784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bae0a-754c-4f38-898b-bd68fe44df5e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:43.870444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bae0a-754c-4f38-898b-bd68fe44df5e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:43.870921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bae0a-754c-4f38-898b-bd68fe44df5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:43.912230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ec4bae0a-754c-4f38-898b-bd68fe44df5e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:43.914041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ec4bae0a-754c-4f38-898b-bd68fe44df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:44.011664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 170/342] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:44.061115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c1f7d-2b78-4cee-87bb-a10b82452f7f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:44.137482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5804294-3286-4f9f-9087-9570b660b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:44.138549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5804294-3286-4f9f-9087-9570b660b235 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:44.139033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5804294-3286-4f9f-9087-9570b660b235 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:44.139508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5804294-3286-4f9f-9087-9570b660b235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:44.161381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:44.221740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bae0a-754c-4f38-898b-bd68fe44df5e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:44.292500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5804294-3286-4f9f-9087-9570b660b235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:44.295406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5804294-3286-4f9f-9087-9570b660b235 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:44.298310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:44.355754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bae0a-754c-4f38-898b-bd68fe44df5e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:44.399523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9399d83-e0f4-4842-a14e-d1e616fad048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:44.400597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399d83-e0f4-4842-a14e-d1e616fad048 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:44.401084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399d83-e0f4-4842-a14e-d1e616fad048 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:44.401553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9399d83-e0f4-4842-a14e-d1e616fad048 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:44.415052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9399d83-e0f4-4842-a14e-d1e616fad048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d9399d83-e0f4-4842-a14e-d1e616fad048 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:44.420966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:44.421915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:44.422705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:44.425253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 171/343] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:44.428360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083d5b6-139f-42ea-bb84-d4f5558d09a7 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:44.433239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083d5b6-139f-42ea-bb84-d4f5558d09a7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:44.433732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083d5b6-139f-42ea-bb84-d4f5558d09a7 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:44.435944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 172/344] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:44.438721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083d5b6-139f-42ea-bb84-d4f5558d09a7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:44.511540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 173/345] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:16:44.513781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24e7b7-940b-46b3-adb2-ae38090a3b06 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:44.514319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24e7b7-940b-46b3-adb2-ae38090a3b06 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:44.514870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24e7b7-940b-46b3-adb2-ae38090a3b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:44.537494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dd24e7b7-940b-46b3-adb2-ae38090a3b06 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:44.539125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dd24e7b7-940b-46b3-adb2-ae38090a3b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:44.583373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:44.638131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 174/346] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:44.639368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24e7b7-940b-46b3-adb2-ae38090a3b06 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:44.659548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083d5b6-139f-42ea-bb84-d4f5558d09a7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:44.695004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:44.745140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:44.747475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:44.748076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:44.748734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:44.750370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:44.751173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:44.753783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:44.777255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 173/347] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:44.783666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:44.836529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24e7b7-940b-46b3-adb2-ae38090a3b06 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:44.891927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205add0-02c6-47aa-9b46-3d68ff8ca8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:44.893099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205add0-02c6-47aa-9b46-3d68ff8ca8ee None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:44.893593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205add0-02c6-47aa-9b46-3d68ff8ca8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:44.894254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205add0-02c6-47aa-9b46-3d68ff8ca8ee None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:44.896190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205add0-02c6-47aa-9b46-3d68ff8ca8ee None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:44.899166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205add0-02c6-47aa-9b46-3d68ff8ca8ee None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:44.901805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 175/348] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:44 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:44.903371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205add0-02c6-47aa-9b46-3d68ff8ca8ee None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:44.950480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:45.020090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07052a2f-b290-4484-a6f3-74264169d579 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:45.069226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2662c8b-6f28-4410-b1a5-6552c6752ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:45.070328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662c8b-6f28-4410-b1a5-6552c6752ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:45.070791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662c8b-6f28-4410-b1a5-6552c6752ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:45.071239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662c8b-6f28-4410-b1a5-6552c6752ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:45.080482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205add0-02c6-47aa-9b46-3d68ff8ca8ee None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:45.136351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:45.155406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9370-fba4-4342-a5a4-4f1cb089840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:45.156784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9370-fba4-4342-a5a4-4f1cb089840a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:45.157564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9370-fba4-4342-a5a4-4f1cb089840a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:45.157990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9370-fba4-4342-a5a4-4f1cb089840a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:45.173388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2662c8b-6f28-4410-b1a5-6552c6752ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:45.176172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2662c8b-6f28-4410-b1a5-6552c6752ac4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:45.183467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f9370-fba4-4342-a5a4-4f1cb089840a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e72f9370-fba4-4342-a5a4-4f1cb089840a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:45.194120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:45.195093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:45.195910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:45.196573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 176/349] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:45.198969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9370-fba4-4342-a5a4-4f1cb089840a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:45.331759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 174/350] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:45.331759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79724-7efa-4100-aa78-2ec1a9669bd5 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:45.331759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79724-7efa-4100-aa78-2ec1a9669bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:45.331759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79724-7efa-4100-aa78-2ec1a9669bd5 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:45.333096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 175/351] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:45.334490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b79724-7efa-4100-aa78-2ec1a9669bd5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:45.390563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:45.402654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9370-fba4-4342-a5a4-4f1cb089840a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:45.460246 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029828b1-360f-4c03-8339-42885ef5572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:45.460597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029828b1-360f-4c03-8339-42885ef5572e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:45.460884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029828b1-360f-4c03-8339-42885ef5572e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:45.461155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029828b1-360f-4c03-8339-42885ef5572e None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:45.468592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029828b1-360f-4c03-8339-42885ef5572e None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:45.470421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029828b1-360f-4c03-8339-42885ef5572e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:45.472255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 177/352] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:45 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:45.473245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029828b1-360f-4c03-8339-42885ef5572e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:45.504997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:45.560443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b79724-7efa-4100-aa78-2ec1a9669bd5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:45.620360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:45.621054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:45.621328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:45.621602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:45.622298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:45.622598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:45.624219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:45.633666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029828b1-360f-4c03-8339-42885ef5572e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:45.637591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 176/353] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:45.638736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:45.688976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed84b3-32f3-4df4-b398-2eae22c6131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:45.689916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed84b3-32f3-4df4-b398-2eae22c6131e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:45.690198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed84b3-32f3-4df4-b398-2eae22c6131e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:45.690473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed84b3-32f3-4df4-b398-2eae22c6131e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:45.704796 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed84b3-32f3-4df4-b398-2eae22c6131e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-70ed84b3-32f3-4df4-b398-2eae22c6131e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:45.710540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:45.711611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:45.712550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 178/354] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:45.713584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2d050-ad6c-49ed-850a-392cc143ebb6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:45.713704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2d050-ad6c-49ed-850a-392cc143ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:45.715261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2d050-ad6c-49ed-850a-392cc143ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:45.736911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-78a2d050-ad6c-49ed-850a-392cc143ebb6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:45.741067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-78a2d050-ad6c-49ed-850a-392cc143ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:45.759759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:45.830856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa6ae1-d99d-4782-9595-bbc1cc5b0f8a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:45.849313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 179/355] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:45.850203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2d050-ad6c-49ed-850a-392cc143ebb6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:45.935260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438a85c-b1f3-482a-866d-7e38d453c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:45.937697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438a85c-b1f3-482a-866d-7e38d453c640 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:45.938539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438a85c-b1f3-482a-866d-7e38d453c640 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:45.939622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438a85c-b1f3-482a-866d-7e38d453c640 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:45.943316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438a85c-b1f3-482a-866d-7e38d453c640 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:45.946054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438a85c-b1f3-482a-866d-7e38d453c640 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:45.949593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 177/356] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:45 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:45.950039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438a85c-b1f3-482a-866d-7e38d453c640 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:45.961519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:46.052296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2d050-ad6c-49ed-850a-392cc143ebb6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:46.126590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438a85c-b1f3-482a-866d-7e38d453c640 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:46.129923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:46.131683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:46.132819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:46.134146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:46.136219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] RBAC: Adding query filter params (group.id=f56fde4d28ff4baf91fe6002e8d7125c, role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:46.137138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:46.140052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:46.152840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 180/357] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:16:45 2022] GET /identity/v3/role_assignments?group.id=f56fde4d28ff4baf91fe6002e8d7125c&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:46.154812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:46.176869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd9d05-e1cf-46c5-9eac-f1c4f554fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:46.178157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd9d05-e1cf-46c5-9eac-f1c4f554fd4b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:46.178157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd9d05-e1cf-46c5-9eac-f1c4f554fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:46.178157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd9d05-e1cf-46c5-9eac-f1c4f554fd4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:46.189444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:46.265221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd9d05-e1cf-46c5-9eac-f1c4f554fd4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:46.266809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd9d05-e1cf-46c5-9eac-f1c4f554fd4b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:46.282367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:46.358399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698ee2-c2de-415d-9e4c-3d1ee089b496 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:46.422246 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:46.423670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:46.424154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:46.424664 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:46.426227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:46.426650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:46.429145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:46.449392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 181/358] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:46.450341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:46.511098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 178/359] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:46.515742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd9d05-e1cf-46c5-9eac-f1c4f554fd4b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:46.606302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:46.639313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c76748-19c1-4889-8f65-73a03e0d8232 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:46.682712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700eb8b-9ee7-48ea-a47a-a0f9d5cb4093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:46.683824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700eb8b-9ee7-48ea-a47a-a0f9d5cb4093 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:46.684446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700eb8b-9ee7-48ea-a47a-a0f9d5cb4093 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:46.684966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700eb8b-9ee7-48ea-a47a-a0f9d5cb4093 None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:46.686455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700eb8b-9ee7-48ea-a47a-a0f9d5cb4093 None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:46.688169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700eb8b-9ee7-48ea-a47a-a0f9d5cb4093 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:46.696439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 182/360] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:46 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:46.696439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1ea3-778d-4842-983c-02eb9b815bef None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:46.696439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1ea3-778d-4842-983c-02eb9b815bef None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:46.696439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1ea3-778d-4842-983c-02eb9b815bef None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:46.699880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 183/361] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:46.700068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1ea3-778d-4842-983c-02eb9b815bef None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:46.731870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd9d05-e1cf-46c5-9eac-f1c4f554fd4b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:46.747597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:46.807479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba589de-6748-4a33-a47e-207f77a00e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:46.809557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba589de-6748-4a33-a47e-207f77a00e3d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:46.810375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba589de-6748-4a33-a47e-207f77a00e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:46.811081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba589de-6748-4a33-a47e-207f77a00e3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:46.837916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba589de-6748-4a33-a47e-207f77a00e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7ba589de-6748-4a33-a47e-207f77a00e3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:46.848801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:46.850514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:16:46.852046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:46.855898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 179/362] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:46.857948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba589de-6748-4a33-a47e-207f77a00e3d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:46.922028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1ea3-778d-4842-983c-02eb9b815bef None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:46.995691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9113d8d-af99-44aa-9769-54d1adf984df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:46.996984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113d8d-af99-44aa-9769-54d1adf984df None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:46.997258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113d8d-af99-44aa-9769-54d1adf984df None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:46.997628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113d8d-af99-44aa-9769-54d1adf984df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:47.026314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:47.073096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba589de-6748-4a33-a47e-207f77a00e3d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:47.140371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9113d8d-af99-44aa-9769-54d1adf984df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:47.143869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9113d8d-af99-44aa-9769-54d1adf984df None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:47.158995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d17a01-c48f-4975-a02b-b8d8e0030176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:47.160161 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d17a01-c48f-4975-a02b-b8d8e0030176 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:47.161383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d17a01-c48f-4975-a02b-b8d8e0030176 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:47.161871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d17a01-c48f-4975-a02b-b8d8e0030176 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:47.163932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d17a01-c48f-4975-a02b-b8d8e0030176 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:47.168749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d17a01-c48f-4975-a02b-b8d8e0030176 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:47.172163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 180/363] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:46 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:47.173249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d17a01-c48f-4975-a02b-b8d8e0030176 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:47.253377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:47.360301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 184/364] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:47.362906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c4f-82f9-4482-8672-74a1a036cc79 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:47.363760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c4f-82f9-4482-8672-74a1a036cc79 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:47.364451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c4f-82f9-4482-8672-74a1a036cc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:47.379561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d17a01-c48f-4975-a02b-b8d8e0030176 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:47.397053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0aef2c4f-82f9-4482-8672-74a1a036cc79 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:47.398543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0aef2c4f-82f9-4482-8672-74a1a036cc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:47.442196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:47.443179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:47.443643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:47.444100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:47.445373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] RBAC: Adding query filter params (group.id=f56fde4d28ff4baf91fe6002e8d7125c, role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=45aad056179f46b1ae71599644f97241) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:47.445898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:47.448305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:47.460008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 181/365] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:16:47 2022] GET /identity/v3/role_assignments?group.id=f56fde4d28ff4baf91fe6002e8d7125c&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:47.461430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:47.470346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:47.545657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 185/366] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:47.547666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2c4f-82f9-4482-8672-74a1a036cc79 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:47.756095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:47.773542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686796a-3eae-4c1e-8fcf-15e688aae40d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:47.854417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2c4f-82f9-4482-8672-74a1a036cc79 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:47.887978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:47.888788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:47.888913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:47.889309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:47.889869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:47.890176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:47.891663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:47.916739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 182/367] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:47.918272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:47.958369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c89441-a609-4b15-8015-015f167d3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:47.959443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89441-a609-4b15-8015-015f167d3044 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:47.959908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89441-a609-4b15-8015-015f167d3044 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:47.960375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89441-a609-4b15-8015-015f167d3044 None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:47.964516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c89441-a609-4b15-8015-015f167d3044 None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:47.967194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c89441-a609-4b15-8015-015f167d3044 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:47.970491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 186/368] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:47 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:47.972041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c89441-a609-4b15-8015-015f167d3044 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:48.072000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:48.146638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c89441-a609-4b15-8015-015f167d3044 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:48.187626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888842-eb41-4887-9d26-6761409d3c30 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:48.215397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212b284-9e8d-4792-91d3-0577a4ed8a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:48.216079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212b284-9e8d-4792-91d3-0577a4ed8a6a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:48.216359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212b284-9e8d-4792-91d3-0577a4ed8a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:48.216676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212b284-9e8d-4792-91d3-0577a4ed8a6a None admin] PATH_INFO: `/v3/users/bd21b41f3cb14f02bf476b8f8ad03bb6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:48.217959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212b284-9e8d-4792-91d3-0577a4ed8a6a None admin] RBAC: Authorizing `identity:get_user(user_id=bd21b41f3cb14f02bf476b8f8ad03bb6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:48.219482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212b284-9e8d-4792-91d3-0577a4ed8a6a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:48.221254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 187/369] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:16:47 2022] GET /identity/v3/users/bd21b41f3cb14f02bf476b8f8ad03bb6 => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:48.227470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212b284-9e8d-4792-91d3-0577a4ed8a6a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:48.258249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f35f5-2607-4923-9354-0f68b48fb67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:48.260149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f35f5-2607-4923-9354-0f68b48fb67c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:48.260567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f35f5-2607-4923-9354-0f68b48fb67c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:48.261282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f35f5-2607-4923-9354-0f68b48fb67c None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:48.264728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f35f5-2607-4923-9354-0f68b48fb67c None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:48.269888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f35f5-2607-4923-9354-0f68b48fb67c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:48.274742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 183/370] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:47 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:48.276848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f35f5-2607-4923-9354-0f68b48fb67c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:48.356527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:48.391387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212b284-9e8d-4792-91d3-0577a4ed8a6a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:48.410541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:48.466461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f35f5-2607-4923-9354-0f68b48fb67c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:48.467252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:48.468842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:48.469707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:48.470508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:48.472312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] RBAC: Adding query filter params (group.id=f56fde4d28ff4baf91fe6002e8d7125c, role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=45aad056179f46b1ae71599644f97241) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:48.473856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:48.477126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:48.492941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 188/371] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:16:48 2022] GET /identity/v3/role_assignments?group.id=f56fde4d28ff4baf91fe6002e8d7125c&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=6385a2f348c0451081ccf442289790ed => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:48.495002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:48.508653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636345e7-8b23-4a52-bb6c-6ed9f4441692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:48.509338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636345e7-8b23-4a52-bb6c-6ed9f4441692 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:48.509652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636345e7-8b23-4a52-bb6c-6ed9f4441692 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:48.509962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636345e7-8b23-4a52-bb6c-6ed9f4441692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:48.528475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636345e7-8b23-4a52-bb6c-6ed9f4441692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-636345e7-8b23-4a52-bb6c-6ed9f4441692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:48.529736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:48.531329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:48.533534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:48.537062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 184/372] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:16:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:48.540481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636345e7-8b23-4a52-bb6c-6ed9f4441692 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:48.745355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:48.757350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1102cd-08db-4a21-9b60-25941b351da6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:48.770632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636345e7-8b23-4a52-bb6c-6ed9f4441692 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:48.813384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482d36c-6f82-4740-b3ce-d043f2ca233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:48.814058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d36c-6f82-4740-b3ce-d043f2ca233d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:48.814346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d36c-6f82-4740-b3ce-d043f2ca233d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:48.814678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d36c-6f82-4740-b3ce-d043f2ca233d None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:48.816445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482d36c-6f82-4740-b3ce-d043f2ca233d None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:48.817847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482d36c-6f82-4740-b3ce-d043f2ca233d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:48.820043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 185/373] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:48 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:48.820949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482d36c-6f82-4740-b3ce-d043f2ca233d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:48.841763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:48.843332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:48.844087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:48.844882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:48.846627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] RBAC: Adding query filter params (role.id=db989ea59ab4489e83c7b010c84f1b91, user.id=bd21b41f3cb14f02bf476b8f8ad03bb6, scope.system=all) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:48.847567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:48.850790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:48.873700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 189/374] 10.222.0.55 () {56 vars in 1308 bytes} [Tue Sep 13 12:16:48 2022] GET /identity/v3/role_assignments?user.id=bd21b41f3cb14f02bf476b8f8ad03bb6&scope.system=all&role.id=db989ea59ab4489e83c7b010c84f1b91 => generated 510 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:48.875472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:48.920223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:49.025412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f68497-ee6e-4cb7-9536-0c10dc123a9d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:49.032953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482d36c-6f82-4740-b3ce-d043f2ca233d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:49.099661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:49.100722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:49.101175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:49.101637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:49.102820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:49.103497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:49.106263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:49.121657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662e3f3-f9af-4377-8a93-754a2e73b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:49.122709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e3f3-f9af-4377-8a93-754a2e73b946 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:49.123190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e3f3-f9af-4377-8a93-754a2e73b946 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:49.123720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e3f3-f9af-4377-8a93-754a2e73b946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:49.125081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e3f3-f9af-4377-8a93-754a2e73b946 None admin] RBAC: Adding query filter params (group.id=f56fde4d28ff4baf91fe6002e8d7125c, role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:49.125806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e3f3-f9af-4377-8a93-754a2e73b946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:49.128511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 186/375] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:49.128986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e3f3-f9af-4377-8a93-754a2e73b946 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:49.135366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:49.149671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 190/376] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:16:48 2022] GET /identity/v3/role_assignments?group.id=f56fde4d28ff4baf91fe6002e8d7125c&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=6385a2f348c0451081ccf442289790ed => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:49.183908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:49.372315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a3af8-ceee-4ed0-9d4c-5b95b2e53ea9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:49.443115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf89dc-9833-4877-9195-8b8e0b0378f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:49.444171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf89dc-9833-4877-9195-8b8e0b0378f9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:49.444709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf89dc-9833-4877-9195-8b8e0b0378f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:49.445188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf89dc-9833-4877-9195-8b8e0b0378f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:49.576403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf89dc-9833-4877-9195-8b8e0b0378f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:49.578145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf89dc-9833-4877-9195-8b8e0b0378f9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:49.602887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:49.727600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39794122-0d5a-458a-93be-fe3c48a4a48b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:49.728315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39794122-0d5a-458a-93be-fe3c48a4a48b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:49.728932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39794122-0d5a-458a-93be-fe3c48a4a48b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:49.730601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 191/377] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:16:49.736504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 187/378] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:49.737286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4367d-ce5c-45ad-9516-e77a1ccc5215 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:49.737975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4367d-ce5c-45ad-9516-e77a1ccc5215 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:49.738634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4367d-ce5c-45ad-9516-e77a1ccc5215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:49.746215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf89dc-9833-4877-9195-8b8e0b0378f9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:49.761821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b5e4367d-ce5c-45ad-9516-e77a1ccc5215 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:49.763539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b5e4367d-ce5c-45ad-9516-e77a1ccc5215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:49.896729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 192/379] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:49.941833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf89dc-9833-4877-9195-8b8e0b0378f9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:49.982433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560dd3-9a09-4d98-ba73-fbb49bd2d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:49.983018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560dd3-9a09-4d98-ba73-fbb49bd2d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:49.983733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560dd3-9a09-4d98-ba73-fbb49bd2d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:49.988671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:49.989749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560dd3-9a09-4d98-ba73-fbb49bd2d0b7 None admin] PATH_INFO: `/v3/projects/2ed37889d9bd46b8ac01745f81e76c42` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:49.991030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b560dd3-9a09-4d98-ba73-fbb49bd2d0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed37889d9bd46b8ac01745f81e76c42)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:49.992656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b560dd3-9a09-4d98-ba73-fbb49bd2d0b7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:49.994496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 188/380] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:49 2022] GET /identity/v3/projects/2ed37889d9bd46b8ac01745f81e76c42 => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:50.001897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4367d-ce5c-45ad-9516-e77a1ccc5215 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:50.072218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:50.179866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4367d-ce5c-45ad-9516-e77a1ccc5215 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:50.221617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00f23-e50f-478d-9685-6a16684439c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:50.222496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00f23-e50f-478d-9685-6a16684439c8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:50.222779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00f23-e50f-478d-9685-6a16684439c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:50.223058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00f23-e50f-478d-9685-6a16684439c8 None admin] PATH_INFO: `/v3/groups/f8bda1d7870c4b1fa84210159c940027` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:50.231296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c00f23-e50f-478d-9685-6a16684439c8 None admin] RBAC: Authorizing `identity:get_group(group_id=f8bda1d7870c4b1fa84210159c940027)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:50.232881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c00f23-e50f-478d-9685-6a16684439c8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:50.234665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 193/381] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:50 2022] GET /identity/v3/groups/f8bda1d7870c4b1fa84210159c940027 => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:50.240990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560dd3-9a09-4d98-ba73-fbb49bd2d0b7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:50.273539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00f23-e50f-478d-9685-6a16684439c8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:50.364234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560dd3-9a09-4d98-ba73-fbb49bd2d0b7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:50.404504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:50.405141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:50.405421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:50.405744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:50.406497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] RBAC: Adding query filter params (group.id=f8bda1d7870c4b1fa84210159c940027, role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=2ed37889d9bd46b8ac01745f81e76c42) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:50.406808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:50.408313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:50.415261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 189/382] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:16:50 2022] GET /identity/v3/role_assignments?group.id=f8bda1d7870c4b1fa84210159c940027&scope.project.id=2ed37889d9bd46b8ac01745f81e76c42&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:50.464065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:50.482508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00f23-e50f-478d-9685-6a16684439c8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:50.529534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6c7fa-1e15-498f-8747-e736c7e46f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:50.530585 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c7fa-1e15-498f-8747-e736c7e46f64 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:50.531061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c7fa-1e15-498f-8747-e736c7e46f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:50.531548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c7fa-1e15-498f-8747-e736c7e46f64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:50.553709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6c7fa-1e15-498f-8747-e736c7e46f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-88b6c7fa-1e15-498f-8747-e736c7e46f64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:50.559347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:50.560319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:50.561176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:50.564001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 194/383] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:50.577635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:50.646359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:50.717742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f4a6-1419-416f-9ed9-cfa93f99b592 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:50.762046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:50.762742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:50.763028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:50.763304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:50.764007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:50.764315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:50.765814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:50.776477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 190/384] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:50.783275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6c7fa-1e15-498f-8747-e736c7e46f64 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:50.975226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6c7fa-1e15-498f-8747-e736c7e46f64 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:51.039678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311a24d-3b68-4611-bc3e-8a351a816427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:51.040799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311a24d-3b68-4611-bc3e-8a351a816427 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:51.041327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311a24d-3b68-4611-bc3e-8a351a816427 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:51.041815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311a24d-3b68-4611-bc3e-8a351a816427 None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:51.049414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311a24d-3b68-4611-bc3e-8a351a816427 None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:51.052467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311a24d-3b68-4611-bc3e-8a351a816427 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:51.054872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 195/385] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:50 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:51.061155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:51.222775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfe30f-3112-4587-9b6f-e86a38678f1f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:51.238170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:51.263013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056ff42-2c1b-48f7-be2f-d6cc89811c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:51.263742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056ff42-2c1b-48f7-be2f-d6cc89811c68 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:51.263983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056ff42-2c1b-48f7-be2f-d6cc89811c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:51.264207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056ff42-2c1b-48f7-be2f-d6cc89811c68 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:51.265521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056ff42-2c1b-48f7-be2f-d6cc89811c68 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:51.267038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056ff42-2c1b-48f7-be2f-d6cc89811c68 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:51.269286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 191/386] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:51 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:51.275501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311a24d-3b68-4611-bc3e-8a351a816427 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:51.318901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:51.448144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311a24d-3b68-4611-bc3e-8a351a816427 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:51.511712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbf60e-82cd-4423-9e0f-c8d658a1dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:51.512861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbf60e-82cd-4423-9e0f-c8d658a1dfc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:51.513372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbf60e-82cd-4423-9e0f-c8d658a1dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:51.513917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbf60e-82cd-4423-9e0f-c8d658a1dfc0 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/groups/f56fde4d28ff4baf91fe6002e8d7125c/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:51.517168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84018e6a-4f63-4288-9011-64823449dc8f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:51.517537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84018e6a-4f63-4288-9011-64823449dc8f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:51.517727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84018e6a-4f63-4288-9011-64823449dc8f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:51.519597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbf60e-82cd-4423-9e0f-c8d658a1dfc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee1c0bcfe004ff78d3746e99b17805f, group_id=f56fde4d28ff4baf91fe6002e8d7125c, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:51.521409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 192/387] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:51.521747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbf60e-82cd-4423-9e0f-c8d658a1dfc0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:51.526569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609431a1-4e5c-402a-913c-7f2ec1698775 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:51.526884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609431a1-4e5c-402a-913c-7f2ec1698775 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:51.527133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609431a1-4e5c-402a-913c-7f2ec1698775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:51.548793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-609431a1-4e5c-402a-913c-7f2ec1698775 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:51.550356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-609431a1-4e5c-402a-913c-7f2ec1698775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:51.551181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 196/388] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Sep 13 12:16:51 2022] PUT /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/groups/f56fde4d28ff4baf91fe6002e8d7125c/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:51.643169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 193/389] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:52.019756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbf60e-82cd-4423-9e0f-c8d658a1dfc0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:52.119402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:52.151583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbf60e-82cd-4423-9e0f-c8d658a1dfc0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:52.201165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735a21d-2c1b-4245-9ded-eb5f19da6c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:52.201831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735a21d-2c1b-4245-9ded-eb5f19da6c17 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:52.202113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735a21d-2c1b-4245-9ded-eb5f19da6c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:52.202388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735a21d-2c1b-4245-9ded-eb5f19da6c17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:52.222065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735a21d-2c1b-4245-9ded-eb5f19da6c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7735a21d-2c1b-4245-9ded-eb5f19da6c17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:52.227853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:52.228816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:52.229620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 197/390] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:52.236352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609431a1-4e5c-402a-913c-7f2ec1698775 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:52.406863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609431a1-4e5c-402a-913c-7f2ec1698775 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:52.418003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976d09-a563-46a8-8d9f-e5765686b2c5 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:52.418366 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976d09-a563-46a8-8d9f-e5765686b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:52.418784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976d09-a563-46a8-8d9f-e5765686b2c5 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:52.420284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 198/391] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:52.422861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:52.427109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f34d-53d6-4be4-945f-714c36117878 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:52.427521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f34d-53d6-4be4-945f-714c36117878 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:52.427888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f34d-53d6-4be4-945f-714c36117878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:52.468007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7885f34d-53d6-4be4-945f-714c36117878 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:52.469709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7885f34d-53d6-4be4-945f-714c36117878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:52.483845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:52.486924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:52.487429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:52.487839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:52.488848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:52.489860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:52.491721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:52.510413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 194/392] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:52.516321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:52.650064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0e3e0-fe3b-4f0b-9997-1664db4fd01c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:52.650290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 199/393] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:52.698274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ef725-e6a1-4cad-8e4a-8de26367f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:52.699182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ef725-e6a1-4cad-8e4a-8de26367f8ea None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:52.699627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ef725-e6a1-4cad-8e4a-8de26367f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:52.700038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ef725-e6a1-4cad-8e4a-8de26367f8ea None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:52.701466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ef725-e6a1-4cad-8e4a-8de26367f8ea None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:52.703277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ef725-e6a1-4cad-8e4a-8de26367f8ea None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:52.705188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 195/394] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:52 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:52.711618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885f34d-53d6-4be4-945f-714c36117878 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:52.824015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:52.876982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885f34d-53d6-4be4-945f-714c36117878 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:52.931702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852b33f-6526-4207-87f8-63be319a2c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:52.932378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852b33f-6526-4207-87f8-63be319a2c36 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:52.932695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852b33f-6526-4207-87f8-63be319a2c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:52.932972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852b33f-6526-4207-87f8-63be319a2c36 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:52.934162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852b33f-6526-4207-87f8-63be319a2c36 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:52.935633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852b33f-6526-4207-87f8-63be319a2c36 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:52.940525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 200/395] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:52 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:52.943607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ef725-e6a1-4cad-8e4a-8de26367f8ea None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:53.025024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:53.128408 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852b33f-6526-4207-87f8-63be319a2c36 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:53.173025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ef725-e6a1-4cad-8e4a-8de26367f8ea None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:53.247600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca4151-02d6-4cc3-9555-37ef84a7873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:53.248750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca4151-02d6-4cc3-9555-37ef84a7873c None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.249226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca4151-02d6-4cc3-9555-37ef84a7873c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.249662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca4151-02d6-4cc3-9555-37ef84a7873c None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241/groups/f56fde4d28ff4baf91fe6002e8d7125c/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.253330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca4151-02d6-4cc3-9555-37ef84a7873c None admin] RBAC: Authorizing `identity:create_grant(project_id=45aad056179f46b1ae71599644f97241, group_id=f56fde4d28ff4baf91fe6002e8d7125c, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:53.256193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca4151-02d6-4cc3-9555-37ef84a7873c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:53.286940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 196/396] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Sep 13 12:16:52 2022] PUT /identity/v3/projects/45aad056179f46b1ae71599644f97241/groups/f56fde4d28ff4baf91fe6002e8d7125c/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:53.289480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59102617-c238-4fc4-bb01-7c88d9727b20 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.289921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59102617-c238-4fc4-bb01-7c88d9727b20 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.290384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59102617-c238-4fc4-bb01-7c88d9727b20 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.295462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852b33f-6526-4207-87f8-63be319a2c36 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:53.296613 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 197/397] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:53.302970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb05a9-1a4e-46cb-906e-d9cb92570358 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.303414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb05a9-1a4e-46cb-906e-d9cb92570358 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.303851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb05a9-1a4e-46cb-906e-d9cb92570358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.337297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c4bb05a9-1a4e-46cb-906e-d9cb92570358 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:53.339433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c4bb05a9-1a4e-46cb-906e-d9cb92570358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:53.367683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20af564-4ecb-4fae-807f-563321bf6421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:53.369337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af564-4ecb-4fae-807f-563321bf6421 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.370124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af564-4ecb-4fae-807f-563321bf6421 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.370951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af564-4ecb-4fae-807f-563321bf6421 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.376429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:53.393347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20af564-4ecb-4fae-807f-563321bf6421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b20af564-4ecb-4fae-807f-563321bf6421 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:53.404882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:53.406709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:53.408309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:53.413390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 201/398] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:53.422596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20af564-4ecb-4fae-807f-563321bf6421 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:53.456372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 198/399] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:53.669117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20af564-4ecb-4fae-807f-563321bf6421 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:53.721124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3ba3-597b-474f-911d-ac1e29889e5b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.722397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3ba3-597b-474f-911d-ac1e29889e5b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.722942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3ba3-597b-474f-911d-ac1e29889e5b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.728611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 199/400] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:53.734925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1200-667b-4652-87c2-b3939832d8a2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.735277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1200-667b-4652-87c2-b3939832d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.735465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1200-667b-4652-87c2-b3939832d8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.741623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:53.742915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:53.744424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:53.744948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:53.745870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:53.746402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:53.748138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:53.755389 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d6ee1200-667b-4652-87c2-b3939832d8a2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:53.756990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d6ee1200-667b-4652-87c2-b3939832d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:53.761905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 202/401] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:53.773050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:53.794977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:53.855765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:53.866182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 200/402] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:53.911019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1200-667b-4652-87c2-b3939832d8a2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:53.945423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5ebc-e8db-4ce5-8c96-baffbbe390c1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.016276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7996c20-c1d8-4c2c-a7be-f253bdb41ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.016965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996c20-c1d8-4c2c-a7be-f253bdb41ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.017246 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996c20-c1d8-4c2c-a7be-f253bdb41ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.017525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7996c20-c1d8-4c2c-a7be-f253bdb41ed5 None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.019087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7996c20-c1d8-4c2c-a7be-f253bdb41ed5 None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:54.020575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7996c20-c1d8-4c2c-a7be-f253bdb41ed5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:54.028671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 203/403] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:53 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:54.030204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7996c20-c1d8-4c2c-a7be-f253bdb41ed5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.070555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1200-667b-4652-87c2-b3939832d8a2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.112005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a55583-31bd-4d83-b9ae-bbdd9030e710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.112756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a55583-31bd-4d83-b9ae-bbdd9030e710 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.113777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a55583-31bd-4d83-b9ae-bbdd9030e710 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.113777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a55583-31bd-4d83-b9ae-bbdd9030e710 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.125862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a55583-31bd-4d83-b9ae-bbdd9030e710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c7a55583-31bd-4d83-b9ae-bbdd9030e710 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:54.131752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:54.135271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:54.138730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 201/404] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:54.150175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a55583-31bd-4d83-b9ae-bbdd9030e710 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.167382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:54.260077 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a55583-31bd-4d83-b9ae-bbdd9030e710 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.301594 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7996c20-c1d8-4c2c-a7be-f253bdb41ed5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.303478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.304301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.304757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.305101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.305973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:54.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:54.307739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:54.322334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 202/405] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:54.323519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.347177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:54.358419 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864b554-78c6-4994-b740-824e07e11d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.359432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864b554-78c6-4994-b740-824e07e11d63 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.359873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864b554-78c6-4994-b740-824e07e11d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.360333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864b554-78c6-4994-b740-824e07e11d63 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.361802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864b554-78c6-4994-b740-824e07e11d63 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:54.363810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864b554-78c6-4994-b740-824e07e11d63 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:54.365874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 204/406] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:54 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:54.367180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864b554-78c6-4994-b740-824e07e11d63 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.468788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:54.480051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32938e0a-045d-42f8-8a90-1157d89bcb41 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.529961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36d448-a5e8-4092-a5a1-121f76ae05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.531044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36d448-a5e8-4092-a5a1-121f76ae05d0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.531550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36d448-a5e8-4092-a5a1-121f76ae05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.532523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36d448-a5e8-4092-a5a1-121f76ae05d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.547963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36d448-a5e8-4092-a5a1-121f76ae05d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-fb36d448-a5e8-4092-a5a1-121f76ae05d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:54.555523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:54.556563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:54.557454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:54.564363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 203/407] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:54.564363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36d448-a5e8-4092-a5a1-121f76ae05d0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.598706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864b554-78c6-4994-b740-824e07e11d63 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.642273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe32f-1536-4f2c-bf05-38433849e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.642971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe32f-1536-4f2c-bf05-38433849e73c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.643253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe32f-1536-4f2c-bf05-38433849e73c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.643607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe32f-1536-4f2c-bf05-38433849e73c None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.645187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe32f-1536-4f2c-bf05-38433849e73c None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:54.646762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe32f-1536-4f2c-bf05-38433849e73c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:54.649313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 205/408] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:54 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:54.650187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe32f-1536-4f2c-bf05-38433849e73c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.736989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:54.800034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe32f-1536-4f2c-bf05-38433849e73c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.801500 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36d448-a5e8-4092-a5a1-121f76ae05d0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.846301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635114da-b518-4843-a117-34922652be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.847322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635114da-b518-4843-a117-34922652be59 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.847615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635114da-b518-4843-a117-34922652be59 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.847889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635114da-b518-4843-a117-34922652be59 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.848623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635114da-b518-4843-a117-34922652be59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:54.849000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635114da-b518-4843-a117-34922652be59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:54.849155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2effbee-29b3-48b4-89b0-e2feafde828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.849901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effbee-29b3-48b4-89b0-e2feafde828d None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.850307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effbee-29b3-48b4-89b0-e2feafde828d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.850480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635114da-b518-4843-a117-34922652be59 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:54.850776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effbee-29b3-48b4-89b0-e2feafde828d None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241/groups/f56fde4d28ff4baf91fe6002e8d7125c/roles/6385a2f348c0451081ccf442289790ed` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.854961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2effbee-29b3-48b4-89b0-e2feafde828d None admin] RBAC: Authorizing `identity:create_grant(project_id=45aad056179f46b1ae71599644f97241, group_id=f56fde4d28ff4baf91fe6002e8d7125c, role_id=6385a2f348c0451081ccf442289790ed)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:54.857558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2effbee-29b3-48b4-89b0-e2feafde828d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:54.864916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 206/409] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:54.866236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635114da-b518-4843-a117-34922652be59 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.882646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 204/410] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Sep 13 12:16:54 2022] PUT /identity/v3/projects/45aad056179f46b1ae71599644f97241/groups/f56fde4d28ff4baf91fe6002e8d7125c/roles/6385a2f348c0451081ccf442289790ed => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:54.890735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59652798-6a8a-497d-871d-ea9ac407adef None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.891401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59652798-6a8a-497d-871d-ea9ac407adef None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.892687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59652798-6a8a-497d-871d-ea9ac407adef None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.900325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 205/411] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:54 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:54.902483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59652798-6a8a-497d-871d-ea9ac407adef None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.906519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:55.063260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59652798-6a8a-497d-871d-ea9ac407adef None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:55.078271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635114da-b518-4843-a117-34922652be59 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:55.117759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b59a4-cecc-4ef8-b72b-32a13b6ad357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:55.118882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b59a4-cecc-4ef8-b72b-32a13b6ad357 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.119450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b59a4-cecc-4ef8-b72b-32a13b6ad357 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.119948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b59a4-cecc-4ef8-b72b-32a13b6ad357 None admin] PATH_INFO: `/v3/groups/f8bda1d7870c4b1fa84210159c940027` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.122205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b59a4-cecc-4ef8-b72b-32a13b6ad357 None admin] RBAC: Authorizing `identity:get_group(group_id=f8bda1d7870c4b1fa84210159c940027)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:55.122485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:55.125320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b59a4-cecc-4ef8-b72b-32a13b6ad357 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:55.128932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 206/412] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:54 2022] GET /identity/v3/groups/f8bda1d7870c4b1fa84210159c940027 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:55.131942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136038-3c84-4589-8de3-a78bdf295c7e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.132901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136038-3c84-4589-8de3-a78bdf295c7e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.133455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136038-3c84-4589-8de3-a78bdf295c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.139907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694a39-024e-4ee1-bc17-921f9a4d6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:55.140982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694a39-024e-4ee1-bc17-921f9a4d6202 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.141443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694a39-024e-4ee1-bc17-921f9a4d6202 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.142021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694a39-024e-4ee1-bc17-921f9a4d6202 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.143788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd694a39-024e-4ee1-bc17-921f9a4d6202 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:55.146034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd694a39-024e-4ee1-bc17-921f9a4d6202 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:55.149901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 207/413] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:54 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:55.156335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694a39-024e-4ee1-bc17-921f9a4d6202 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:55.169498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3a136038-3c84-4589-8de3-a78bdf295c7e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:55.170917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3a136038-3c84-4589-8de3-a78bdf295c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:55.284849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694a39-024e-4ee1-bc17-921f9a4d6202 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:55.292788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:55.301547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 207/414] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:55.308649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136038-3c84-4589-8de3-a78bdf295c7e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:55.336323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4241dd0-e1e5-4e47-826d-5122bc064811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:55.337753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241dd0-e1e5-4e47-826d-5122bc064811 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.338259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241dd0-e1e5-4e47-826d-5122bc064811 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.338741 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241dd0-e1e5-4e47-826d-5122bc064811 None admin] PATH_INFO: `/v3/projects/2ed37889d9bd46b8ac01745f81e76c42` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.340248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4241dd0-e1e5-4e47-826d-5122bc064811 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed37889d9bd46b8ac01745f81e76c42)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:55.342041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4241dd0-e1e5-4e47-826d-5122bc064811 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:55.344088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 208/415] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:55 2022] GET /identity/v3/projects/2ed37889d9bd46b8ac01745f81e76c42 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:55.353467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4241dd0-e1e5-4e47-826d-5122bc064811 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:55.453871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:55.580272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4241dd0-e1e5-4e47-826d-5122bc064811 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:55.615876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136038-3c84-4589-8de3-a78bdf295c7e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:55.639311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e199fb-c737-44dc-a371-ce826b9b91c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:55.640306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e199fb-c737-44dc-a371-ce826b9b91c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.640778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e199fb-c737-44dc-a371-ce826b9b91c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.641192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e199fb-c737-44dc-a371-ce826b9b91c8 None admin] PATH_INFO: `/v3/projects/2ed37889d9bd46b8ac01745f81e76c42/groups/f8bda1d7870c4b1fa84210159c940027/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.643608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e199fb-c737-44dc-a371-ce826b9b91c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ed37889d9bd46b8ac01745f81e76c42, group_id=f8bda1d7870c4b1fa84210159c940027, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:55.645959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e199fb-c737-44dc-a371-ce826b9b91c8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:55.672708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 209/416] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Sep 13 12:16:55 2022] PUT /identity/v3/projects/2ed37889d9bd46b8ac01745f81e76c42/groups/f8bda1d7870c4b1fa84210159c940027/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:55.674079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e199fb-c737-44dc-a371-ce826b9b91c8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:55.686695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e79ee-326d-42d5-a489-dfdc791849b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:55.687844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e79ee-326d-42d5-a489-dfdc791849b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.688328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e79ee-326d-42d5-a489-dfdc791849b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.696620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e79ee-326d-42d5-a489-dfdc791849b4 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/groups/f56fde4d28ff4baf91fe6002e8d7125c/roles/6385a2f348c0451081ccf442289790ed` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.696620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e79ee-326d-42d5-a489-dfdc791849b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee1c0bcfe004ff78d3746e99b17805f, group_id=f56fde4d28ff4baf91fe6002e8d7125c, role_id=6385a2f348c0451081ccf442289790ed)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:55.696620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e79ee-326d-42d5-a489-dfdc791849b4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:55.741567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 208/417] 10.222.0.55 () {58 vars in 1442 bytes} [Tue Sep 13 12:16:55 2022] PUT /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f/groups/f56fde4d28ff4baf91fe6002e8d7125c/roles/6385a2f348c0451081ccf442289790ed => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:55.820770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e199fb-c737-44dc-a371-ce826b9b91c8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:55.848158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:55.868083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbebd09-4e0a-4396-a5b4-5cd3c08566ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:55.868799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebd09-4e0a-4396-a5b4-5cd3c08566ff None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.869120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebd09-4e0a-4396-a5b4-5cd3c08566ff None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.869420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbebd09-4e0a-4396-a5b4-5cd3c08566ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.884409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbebd09-4e0a-4396-a5b4-5cd3c08566ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1fbebd09-4e0a-4396-a5b4-5cd3c08566ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:55.890209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:55.891893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:16:55.893560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 210/418] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:55.901613 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e79ee-326d-42d5-a489-dfdc791849b4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:56.011722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:56.082560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e79ee-326d-42d5-a489-dfdc791849b4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:56.134840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:56.135475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:56.135756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:56.136031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:56.136770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:56.137074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:56.138502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:56.156287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 209/419] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:56.157738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbebd09-4e0a-4396-a5b4-5cd3c08566ff None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:56.292741 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbebd09-4e0a-4396-a5b4-5cd3c08566ff None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:56.352063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b66c-81df-40f8-bbc6-765af03be260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:56.353092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b66c-81df-40f8-bbc6-765af03be260 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:56.353092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b66c-81df-40f8-bbc6-765af03be260 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:56.353364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b66c-81df-40f8-bbc6-765af03be260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:56.419158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:56.443540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2b66c-81df-40f8-bbc6-765af03be260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:56.445154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2b66c-81df-40f8-bbc6-765af03be260 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:56.573231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 211/420] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:56.583016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:56.801226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ef9a7-ff8b-439f-904f-871f4d0e5519 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:56.840195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:56.855856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca53262-c9b4-45a0-9fb0-37b414236d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:56.856567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53262-c9b4-45a0-9fb0-37b414236d2a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:56.856838 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53262-c9b4-45a0-9fb0-37b414236d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:56.857115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca53262-c9b4-45a0-9fb0-37b414236d2a None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:56.861295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca53262-c9b4-45a0-9fb0-37b414236d2a None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:56.863044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca53262-c9b4-45a0-9fb0-37b414236d2a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:56.865449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 210/421] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:56 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:56.873768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b66c-81df-40f8-bbc6-765af03be260 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:56.985776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:57.019364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b66c-81df-40f8-bbc6-765af03be260 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:57.064178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47efc3-5a57-4e9b-87bd-b17a40e87470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:57.064911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47efc3-5a57-4e9b-87bd-b17a40e87470 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:57.065199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47efc3-5a57-4e9b-87bd-b17a40e87470 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:57.065575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47efc3-5a57-4e9b-87bd-b17a40e87470 None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:57.073455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47efc3-5a57-4e9b-87bd-b17a40e87470 None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:57.075044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47efc3-5a57-4e9b-87bd-b17a40e87470 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:57.076934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 212/422] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:56 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:57.086409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca53262-c9b4-45a0-9fb0-37b414236d2a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:57.202268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0055a2-f9a7-4865-8058-c9f9403dce88 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:57.203333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0055a2-f9a7-4865-8058-c9f9403dce88 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:57.204055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0055a2-f9a7-4865-8058-c9f9403dce88 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:57.208707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 213/423] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:16:57.219434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26ba45-ff99-4cb4-8dee-3627024aff7d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:57.220372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26ba45-ff99-4cb4-8dee-3627024aff7d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:57.221121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26ba45-ff99-4cb4-8dee-3627024aff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:57.257145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fb26ba45-ff99-4cb4-8dee-3627024aff7d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:57.258785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca53262-c9b4-45a0-9fb0-37b414236d2a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:57.259765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fb26ba45-ff99-4cb4-8dee-3627024aff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:57.339834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:57.341472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:57.342316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:57.343073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:57.344770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] RBAC: Adding query filter params (group.id=f56fde4d28ff4baf91fe6002e8d7125c, role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:57.345765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:57.348961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:57.360872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 211/424] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:16:57 2022] GET /identity/v3/role_assignments?group.id=f56fde4d28ff4baf91fe6002e8d7125c&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 611 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:57.439270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 214/425] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:57.938919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:58.042055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:58.095928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d094117-f708-4d43-a4c5-28a91d55ee72 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:58.137928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac6918-ca36-43c3-be4c-1543d11eb9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:58.138592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac6918-ca36-43c3-be4c-1543d11eb9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:58.138871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac6918-ca36-43c3-be4c-1543d11eb9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:58.139140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac6918-ca36-43c3-be4c-1543d11eb9e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:58.152643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac6918-ca36-43c3-be4c-1543d11eb9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-4cac6918-ca36-43c3-be4c-1543d11eb9e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:58.159655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:58.160733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:58.161563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 212/426] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:16:58.167428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26ba45-ff99-4cb4-8dee-3627024aff7d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:58.300629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:58.343473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26ba45-ff99-4cb4-8dee-3627024aff7d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:58.410964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c8c23-3c2d-4466-85eb-eb22d7079b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:58.411917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c8c23-3c2d-4466-85eb-eb22d7079b57 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:58.412331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c8c23-3c2d-4466-85eb-eb22d7079b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:58.412783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c8c23-3c2d-4466-85eb-eb22d7079b57 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:58.413884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c8c23-3c2d-4466-85eb-eb22d7079b57 None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:58.414365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c8c23-3c2d-4466-85eb-eb22d7079b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:58.416756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c8c23-3c2d-4466-85eb-eb22d7079b57 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:58.432729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 215/427] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:16:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:58.439179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac6918-ca36-43c3-be4c-1543d11eb9e6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:58.564240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac6918-ca36-43c3-be4c-1543d11eb9e6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:58.601840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:58.608332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c61563-0867-4cc0-87dd-8d26bda15ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:58.609214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61563-0867-4cc0-87dd-8d26bda15ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:58.609518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61563-0867-4cc0-87dd-8d26bda15ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:58.609794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61563-0867-4cc0-87dd-8d26bda15ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:58.622203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f052b-a6a9-426d-a400-572332a3cd9b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:58.623049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f052b-a6a9-426d-a400-572332a3cd9b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:58.623185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f052b-a6a9-426d-a400-572332a3cd9b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:58.626314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 216/428] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:58.635466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa41be-256b-415f-985f-cdc3ed814821 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:58.635914 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa41be-256b-415f-985f-cdc3ed814821 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:58.636417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa41be-256b-415f-985f-cdc3ed814821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:58.670813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-baaa41be-256b-415f-985f-cdc3ed814821 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:58.673182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-baaa41be-256b-415f-985f-cdc3ed814821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:58.694659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c61563-0867-4cc0-87dd-8d26bda15ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:58.696186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c61563-0867-4cc0-87dd-8d26bda15ef6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:58.812627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 217/429] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:58.828104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 213/430] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:16:58.835019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa41be-256b-415f-985f-cdc3ed814821 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:58.933193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589960-6e31-4ae8-a6f0-14f4342b2be6 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:58.933686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589960-6e31-4ae8-a6f0-14f4342b2be6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:58.933953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589960-6e31-4ae8-a6f0-14f4342b2be6 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:58.935607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 214/431] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:58.947087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027854c-24fb-49e4-8959-07ae7b7d9e6f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:58.948166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027854c-24fb-49e4-8959-07ae7b7d9e6f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:58.948166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027854c-24fb-49e4-8959-07ae7b7d9e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:58.975941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:58.984015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d027854c-24fb-49e4-8959-07ae7b7d9e6f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:58.986391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d027854c-24fb-49e4-8959-07ae7b7d9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:59.008749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:59.039850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa41be-256b-415f-985f-cdc3ed814821 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:59.105851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a733c1-f276-43a4-9be6-6f07c23b9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:59.106751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a733c1-f276-43a4-9be6-6f07c23b9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:59.107388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a733c1-f276-43a4-9be6-6f07c23b9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:59.108021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a733c1-f276-43a4-9be6-6f07c23b9fe9 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:59.110291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a733c1-f276-43a4-9be6-6f07c23b9fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:59.113090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a733c1-f276-43a4-9be6-6f07c23b9fe9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:59.116839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 218/432] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:16:58 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:59.118523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338736e-8385-46d7-845c-5ae658ac04e9 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:59.118889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338736e-8385-46d7-845c-5ae658ac04e9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:59.119243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338736e-8385-46d7-845c-5ae658ac04e9 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:59.120771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 219/433] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:59.122256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338736e-8385-46d7-845c-5ae658ac04e9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:59.129641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 215/434] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:16:59.131046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc6f9-913b-4193-ac57-8b14914912ae None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:59.131338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc6f9-913b-4193-ac57-8b14914912ae None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:59.131610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc6f9-913b-4193-ac57-8b14914912ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:59.153041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-719fc6f9-913b-4193-ac57-8b14914912ae None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:59.154843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-719fc6f9-913b-4193-ac57-8b14914912ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:59.237850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 216/435] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:16:59.241445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fc6f9-913b-4193-ac57-8b14914912ae None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:59.289903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338736e-8385-46d7-845c-5ae658ac04e9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:59.372753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9215-9738-4a3f-a535-80dbf8028f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:59.373702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9215-9738-4a3f-a535-80dbf8028f61 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:59.374127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9215-9738-4a3f-a535-80dbf8028f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:59.374546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9215-9738-4a3f-a535-80dbf8028f61 None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:59.378033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d9215-9738-4a3f-a535-80dbf8028f61 None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:59.381486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d9215-9738-4a3f-a535-80dbf8028f61 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:59.387106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 220/436] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:16:59 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:59.396459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:59.397532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9215-9738-4a3f-a535-80dbf8028f61 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:59.408800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:59.446561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fc6f9-913b-4193-ac57-8b14914912ae None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:59.497883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f30eb1-b09d-478b-86b3-81b9a618b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:59.498545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30eb1-b09d-478b-86b3-81b9a618b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:59.498820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30eb1-b09d-478b-86b3-81b9a618b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:59.499087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30eb1-b09d-478b-86b3-81b9a618b5c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:59.511706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f30eb1-b09d-478b-86b3-81b9a618b5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f2f30eb1-b09d-478b-86b3-81b9a618b5c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:59.516884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:59.517849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 217/437] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:59.519467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f30eb1-b09d-478b-86b3-81b9a618b5c2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:59.534933 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9215-9738-4a3f-a535-80dbf8028f61 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:59.582085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:59.582720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:59.582992 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:59.583275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:59.584022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] RBAC: Adding query filter params (group.id=f56fde4d28ff4baf91fe6002e8d7125c, role.id=82ff5c8680ab48edba50f88b12a0c000, scope.project.id=45aad056179f46b1ae71599644f97241) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:59.584331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:59.585855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:59.592809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 221/438] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:16:59 2022] GET /identity/v3/role_assignments?group.id=f56fde4d28ff4baf91fe6002e8d7125c&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=82ff5c8680ab48edba50f88b12a0c000 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:59.593886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:59.677699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f30eb1-b09d-478b-86b3-81b9a618b5c2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:59.711541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:59.731555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0078e4-0a01-48f6-8762-ab7ddb61e537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:59.732229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0078e4-0a01-48f6-8762-ab7ddb61e537 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:59.732679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0078e4-0a01-48f6-8762-ab7ddb61e537 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:59.732952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0078e4-0a01-48f6-8762-ab7ddb61e537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:59.735934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:59.749183 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0078e4-0a01-48f6-8762-ab7ddb61e537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1d0078e4-0a01-48f6-8762-ab7ddb61e537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:16:59.755955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:16:59.757165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:16:59.757986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 218/439] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:16:59.760677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0078e4-0a01-48f6-8762-ab7ddb61e537 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:59.765363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d60f2a-7609-484a-bb4b-4228fc5cfbce None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:59.817829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61071132-6311-4258-825d-2b389904b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:59.818502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61071132-6311-4258-825d-2b389904b429 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:59.818755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61071132-6311-4258-825d-2b389904b429 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:59.818985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61071132-6311-4258-825d-2b389904b429 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:59.819675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61071132-6311-4258-825d-2b389904b429 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:59.819982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61071132-6311-4258-825d-2b389904b429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:59.821529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61071132-6311-4258-825d-2b389904b429 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:59.831148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 222/440] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:16:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:59.832042 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61071132-6311-4258-825d-2b389904b429 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:59.933456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0078e4-0a01-48f6-8762-ab7ddb61e537 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:00.002348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3dc1b-e94c-4ebc-a7cd-6b8016267ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:00.003488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3dc1b-e94c-4ebc-a7cd-6b8016267ebf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:00.003974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3dc1b-e94c-4ebc-a7cd-6b8016267ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:00.006774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3dc1b-e94c-4ebc-a7cd-6b8016267ebf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:00.006932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61071132-6311-4258-825d-2b389904b429 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:00.026793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3dc1b-e94c-4ebc-a7cd-6b8016267ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-51a3dc1b-e94c-4ebc-a7cd-6b8016267ebf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:00.038501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:00.039649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:00.040620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 219/441] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:16:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:00.042257 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3dc1b-e94c-4ebc-a7cd-6b8016267ebf None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:00.075277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:00.087348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:00.088867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:00.089018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:00.089439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:00.090750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:00.091257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:00.093999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:00.110365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 223/442] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:00.111986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:00.131149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:00.190727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3dc1b-e94c-4ebc-a7cd-6b8016267ebf None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:00.235842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b474-a675-4802-b8ec-f8cd10fe893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:00.236630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b474-a675-4802-b8ec-f8cd10fe893d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:00.236976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b474-a675-4802-b8ec-f8cd10fe893d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:00.237652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b474-a675-4802-b8ec-f8cd10fe893d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:00.252944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5172ad5-feaa-4dc0-94de-e2fd27e88221 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:00.295813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:00.296527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:00.296757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:00.297044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:00.297722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:00.298027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:00.299433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:00.309039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 224/443] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:00.309917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:00.325695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b474-a675-4802-b8ec-f8cd10fe893d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:00.327243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b474-a675-4802-b8ec-f8cd10fe893d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:00.379514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:00.404097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:00.451195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b8e1f-5e4b-4efc-8ede-f6f21487c743 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:00.479369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 220/444] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:00.480806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b474-a675-4802-b8ec-f8cd10fe893d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:00.510743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f9373-6a46-479d-976a-8ba5f44ff491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:00.511645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f9373-6a46-479d-976a-8ba5f44ff491 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:00.512062 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f9373-6a46-479d-976a-8ba5f44ff491 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:00.512518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f9373-6a46-479d-976a-8ba5f44ff491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:00.600676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f9373-6a46-479d-976a-8ba5f44ff491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:00.602767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f9373-6a46-479d-976a-8ba5f44ff491 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:00.609451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b474-a675-4802-b8ec-f8cd10fe893d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:00.653641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcd59d-793d-4bd3-aa3b-26bb7f2f33c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:00.654281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd59d-793d-4bd3-aa3b-26bb7f2f33c2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:00.654552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd59d-793d-4bd3-aa3b-26bb7f2f33c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:00.654924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd59d-793d-4bd3-aa3b-26bb7f2f33c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:00.686611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:00.696744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:00.737479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcd59d-793d-4bd3-aa3b-26bb7f2f33c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:00.740623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcd59d-793d-4bd3-aa3b-26bb7f2f33c2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:00.781798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 225/445] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:00.783328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f9373-6a46-479d-976a-8ba5f44ff491 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:00.885744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 221/446] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:00.887335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcd59d-793d-4bd3-aa3b-26bb7f2f33c2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:00.929028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f9373-6a46-479d-976a-8ba5f44ff491 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:00.976523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6b491-6446-4a2e-aea7-5ec10353ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:00.977505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b491-6446-4a2e-aea7-5ec10353ec49 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:00.977895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b491-6446-4a2e-aea7-5ec10353ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:00.978278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6b491-6446-4a2e-aea7-5ec10353ec49 None admin] PATH_INFO: `/v3/projects/45aad056179f46b1ae71599644f97241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:00.979705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6b491-6446-4a2e-aea7-5ec10353ec49 None admin] RBAC: Authorizing `identity:get_project(project_id=45aad056179f46b1ae71599644f97241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:00.981364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:00.981836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6b491-6446-4a2e-aea7-5ec10353ec49 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:00.984598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 226/447] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:17:00 2022] GET /identity/v3/projects/45aad056179f46b1ae71599644f97241 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:00.991098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6b491-6446-4a2e-aea7-5ec10353ec49 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:01.022586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:01.039485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcd59d-793d-4bd3-aa3b-26bb7f2f33c2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.083033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41260e-4093-4936-8963-da53e803e9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.084146 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41260e-4093-4936-8963-da53e803e9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.084540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41260e-4093-4936-8963-da53e803e9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.084898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41260e-4093-4936-8963-da53e803e9e0 None admin] PATH_INFO: `/v3/projects/2ed37889d9bd46b8ac01745f81e76c42` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.086314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41260e-4093-4936-8963-da53e803e9e0 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed37889d9bd46b8ac01745f81e76c42)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.088220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41260e-4093-4936-8963-da53e803e9e0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.090664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 222/448] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:17:00 2022] GET /identity/v3/projects/2ed37889d9bd46b8ac01745f81e76c42 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:01.091815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41260e-4093-4936-8963-da53e803e9e0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:01.126998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6b491-6446-4a2e-aea7-5ec10353ec49 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.179877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a12d-30ca-4c46-b5b6-07f109cd86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.180789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a12d-30ca-4c46-b5b6-07f109cd86f6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.181200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a12d-30ca-4c46-b5b6-07f109cd86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.181563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a12d-30ca-4c46-b5b6-07f109cd86f6 None admin] PATH_INFO: `/v3/projects/eee1c0bcfe004ff78d3746e99b17805f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.183001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13a12d-30ca-4c46-b5b6-07f109cd86f6 None admin] RBAC: Authorizing `identity:get_project(project_id=eee1c0bcfe004ff78d3746e99b17805f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.184689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13a12d-30ca-4c46-b5b6-07f109cd86f6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.186591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 227/449] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:17:00 2022] GET /identity/v3/projects/eee1c0bcfe004ff78d3746e99b17805f => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:01.187569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a12d-30ca-4c46-b5b6-07f109cd86f6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:01.244218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41260e-4093-4936-8963-da53e803e9e0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.279210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:01.293585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b089a-30d3-42d3-a35b-f3f87bdc7699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.294241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b089a-30d3-42d3-a35b-f3f87bdc7699 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.294519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b089a-30d3-42d3-a35b-f3f87bdc7699 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.294790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b089a-30d3-42d3-a35b-f3f87bdc7699 None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.296015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b089a-30d3-42d3-a35b-f3f87bdc7699 None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.297555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b089a-30d3-42d3-a35b-f3f87bdc7699 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.299239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 223/450] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:17:01 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:01.300409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b089a-30d3-42d3-a35b-f3f87bdc7699 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:01.340180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:01.357330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a12d-30ca-4c46-b5b6-07f109cd86f6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.421795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71057-ab6a-4345-a6de-c80abf6e2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.422913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71057-ab6a-4345-a6de-c80abf6e2da5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.423423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71057-ab6a-4345-a6de-c80abf6e2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.423931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71057-ab6a-4345-a6de-c80abf6e2da5 None admin] PATH_INFO: `/v3/groups/f8bda1d7870c4b1fa84210159c940027` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.426627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d71057-ab6a-4345-a6de-c80abf6e2da5 None admin] RBAC: Authorizing `identity:get_group(group_id=f8bda1d7870c4b1fa84210159c940027)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.429548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d71057-ab6a-4345-a6de-c80abf6e2da5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.432776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 228/451] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:17:01 2022] GET /identity/v3/groups/f8bda1d7870c4b1fa84210159c940027 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:01.434223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71057-ab6a-4345-a6de-c80abf6e2da5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:01.442543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b089a-30d3-42d3-a35b-f3f87bdc7699 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.490453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7bbd-c845-4979-8e55-010e81949144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.491135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7bbd-c845-4979-8e55-010e81949144 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.491416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7bbd-c845-4979-8e55-010e81949144 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.491680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7bbd-c845-4979-8e55-010e81949144 None admin] PATH_INFO: `/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.493095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc7bbd-c845-4979-8e55-010e81949144 None admin] RBAC: Authorizing `identity:get_group(group_id=f56fde4d28ff4baf91fe6002e8d7125c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.494689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc7bbd-c845-4979-8e55-010e81949144 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.496371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 224/452] 10.222.0.55 () {56 vars in 1180 bytes} [Tue Sep 13 12:17:01 2022] GET /identity/v3/groups/f56fde4d28ff4baf91fe6002e8d7125c => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:01.497246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7bbd-c845-4979-8e55-010e81949144 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:01.591626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71057-ab6a-4345-a6de-c80abf6e2da5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.604573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:01.650516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.651490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.651935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.652417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.653684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] RBAC: Adding query filter params (group.id=f56fde4d28ff4baf91fe6002e8d7125c, role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=45aad056179f46b1ae71599644f97241) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:01.654194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.656436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.666491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 229/453] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:17:01 2022] GET /identity/v3/role_assignments?group.id=f56fde4d28ff4baf91fe6002e8d7125c&scope.project.id=45aad056179f46b1ae71599644f97241&role.id=6385a2f348c0451081ccf442289790ed => generated 611 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:01.667385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:01.674424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7bbd-c845-4979-8e55-010e81949144 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.704422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:01.750087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7749a-7f4b-4db6-bb9f-ceb4cc9dc3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.751706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7749a-7f4b-4db6-bb9f-ceb4cc9dc3ae None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.752173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7749a-7f4b-4db6-bb9f-ceb4cc9dc3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.752684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7749a-7f4b-4db6-bb9f-ceb4cc9dc3ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.754127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7749a-7f4b-4db6-bb9f-ceb4cc9dc3ae None admin] RBAC: Adding query filter params (group.id=f8bda1d7870c4b1fa84210159c940027, role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=2ed37889d9bd46b8ac01745f81e76c42) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:01.754633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7749a-7f4b-4db6-bb9f-ceb4cc9dc3ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.757473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7749a-7f4b-4db6-bb9f-ceb4cc9dc3ae None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.780430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 225/454] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:17:01 2022] GET /identity/v3/role_assignments?group.id=f8bda1d7870c4b1fa84210159c940027&scope.project.id=2ed37889d9bd46b8ac01745f81e76c42&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 611 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:01.865549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340d360-f6d4-4d28-8be3-77d0c4afdfc0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:01.956819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5a588-8efb-421b-a2ce-95cf00da9461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:01.958078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5a588-8efb-421b-a2ce-95cf00da9461 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:01.958527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5a588-8efb-421b-a2ce-95cf00da9461 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:01.958906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5a588-8efb-421b-a2ce-95cf00da9461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:01.959835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5a588-8efb-421b-a2ce-95cf00da9461 None admin] RBAC: Adding query filter params (group.id=f56fde4d28ff4baf91fe6002e8d7125c, role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=eee1c0bcfe004ff78d3746e99b17805f) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:01.960349 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5a588-8efb-421b-a2ce-95cf00da9461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:01.962425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5a588-8efb-421b-a2ce-95cf00da9461 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:01.971596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 230/455] 10.222.0.55 () {56 vars in 1376 bytes} [Tue Sep 13 12:17:01 2022] GET /identity/v3/role_assignments?group.id=f56fde4d28ff4baf91fe6002e8d7125c&scope.project.id=eee1c0bcfe004ff78d3746e99b17805f&role.id=6385a2f348c0451081ccf442289790ed => generated 611 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:05.689274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ef5b2-4487-419b-a98f-c737e04b3d08 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:05.690572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ef5b2-4487-419b-a98f-c737e04b3d08 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:05.691310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ef5b2-4487-419b-a98f-c737e04b3d08 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:05.694427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 226/456] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:05.700821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4925b-715f-4f91-adaa-06fba625ea4c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:05.702083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4925b-715f-4f91-adaa-06fba625ea4c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:05.702790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4925b-715f-4f91-adaa-06fba625ea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:05.715736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458244f-90b2-4d49-bde5-2d2cb5cf9bbf None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:05.716224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458244f-90b2-4d49-bde5-2d2cb5cf9bbf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:05.716754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458244f-90b2-4d49-bde5-2d2cb5cf9bbf None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:05.719640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 227/457] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:17:05.727971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f71200-acfb-4f8c-8278-0e8a06929215 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:05.728483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f71200-acfb-4f8c-8278-0e8a06929215 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:05.728978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f71200-acfb-4f8c-8278-0e8a06929215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:05.736041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4ba4925b-715f-4f91-adaa-06fba625ea4c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:05.738155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4ba4925b-715f-4f91-adaa-06fba625ea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:05.782256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-64f71200-acfb-4f8c-8278-0e8a06929215 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:05.784416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-64f71200-acfb-4f8c-8278-0e8a06929215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:05.895115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 231/458] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:05.914314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 228/459] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:06.119911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8511bf-c1a4-402e-90ba-88ce2e61dabb None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:06.120447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8511bf-c1a4-402e-90ba-88ce2e61dabb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:06.121158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8511bf-c1a4-402e-90ba-88ce2e61dabb None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:06.124318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 232/460] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:06.132967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e380-1cc1-4daa-8f61-19f1647195ea None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:06.133401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e380-1cc1-4daa-8f61-19f1647195ea None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:06.133778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e380-1cc1-4daa-8f61-19f1647195ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:06.161752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c241e380-1cc1-4daa-8f61-19f1647195ea None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:06.162896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c241e380-1cc1-4daa-8f61-19f1647195ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:06.240819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:06.271420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 229/461] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:17:06.331260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8511bf-c1a4-402e-90ba-88ce2e61dabb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:06.382909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:06.464426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e380-1cc1-4daa-8f61-19f1647195ea None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:06.619505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8511bf-c1a4-402e-90ba-88ce2e61dabb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:06.640206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e380-1cc1-4daa-8f61-19f1647195ea None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:06.707016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cdd5f-d651-4ba4-a49e-0bcc2074a76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:06.709148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cdd5f-d651-4ba4-a49e-0bcc2074a76f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:06.709912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cdd5f-d651-4ba4-a49e-0bcc2074a76f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:06.710617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cdd5f-d651-4ba4-a49e-0bcc2074a76f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:06.726633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:06.727688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:06.728218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:06.728704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:06.736220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cdd5f-d651-4ba4-a49e-0bcc2074a76f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:06.739615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cdd5f-d651-4ba4-a49e-0bcc2074a76f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:06.755019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:06.758765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-bd4cdd5f-d651-4ba4-a49e-0bcc2074a76f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:06.776715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:06.778739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:06.780750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:06.780750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:06.780750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:06.783943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 233/462] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:06.786842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597ac1-8248-41c1-9836-22cf742267cc None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:06.787639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597ac1-8248-41c1-9836-22cf742267cc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:06.788295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597ac1-8248-41c1-9836-22cf742267cc None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:06.796229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 234/463] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:06.797777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:06.799702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:06.807756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:06.807756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:06.807756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:06.807756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 230/464] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:06.808198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597ac1-8248-41c1-9836-22cf742267cc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:06.814878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:06.887997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:06.952710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:06.996202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597ac1-8248-41c1-9836-22cf742267cc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:07.010744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3410a-850d-4bc4-bfcc-b703c1080822 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:07.046893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a43d9-8fae-4b63-96c0-d5a7361415e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:07.047533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a43d9-8fae-4b63-96c0-d5a7361415e8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.047805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a43d9-8fae-4b63-96c0-d5a7361415e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.048085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a43d9-8fae-4b63-96c0-d5a7361415e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.048801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a43d9-8fae-4b63-96c0-d5a7361415e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:07.049124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a43d9-8fae-4b63-96c0-d5a7361415e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:07.050674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a43d9-8fae-4b63-96c0-d5a7361415e8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:07.065827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 235/465] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:07.071407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb60af-8329-4e34-9e91-cca31cdb98c1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.071970 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb60af-8329-4e34-9e91-cca31cdb98c1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.072514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb60af-8329-4e34-9e91-cca31cdb98c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.082024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:07.083080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.083545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.084009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.085190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:07.085702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:07.088315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:07.106840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7afb60af-8329-4e34-9e91-cca31cdb98c1 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:07.108415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7afb60af-8329-4e34-9e91-cca31cdb98c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:07.113146 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 231/466] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:07.114540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:07.212421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 236/467] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:07.212421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb60af-8329-4e34-9e91-cca31cdb98c1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:07.306498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:07.324364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:07.335935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267549a1-c465-451c-9bbb-5fb033c11e91 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:07.374803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb60af-8329-4e34-9e91-cca31cdb98c1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:07.385377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:07.386449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.386798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.387080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.402758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:07.405524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:07.426767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ecf30-9795-4111-b1e4-1bc1adece24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:07.427421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ecf30-9795-4111-b1e4-1bc1adece24d None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.427761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ecf30-9795-4111-b1e4-1bc1adece24d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.428035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ecf30-9795-4111-b1e4-1bc1adece24d None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.428840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ecf30-9795-4111-b1e4-1bc1adece24d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:07.430689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ecf30-9795-4111-b1e4-1bc1adece24d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:07.432109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:07.433037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:07.433867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:07.433867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:07.433867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:07.441306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 232/468] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:07.441306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:07.475152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 237/469] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:17:07 2022] POST /identity/v3/users => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:17:07.475152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2da0-7026-4122-8c60-b1ba83808bce None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.475152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2da0-7026-4122-8c60-b1ba83808bce None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.475152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2da0-7026-4122-8c60-b1ba83808bce None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.480461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 238/470] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:07.480461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e2da0-7026-4122-8c60-b1ba83808bce None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:07.632921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960611-05f7-4a05-909a-d553126e20e6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:07.638824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e2da0-7026-4122-8c60-b1ba83808bce None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:07.670494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:07.698383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf45b4-b7c1-48c6-873c-716a0339c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:07.699026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf45b4-b7c1-48c6-873c-716a0339c793 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.699316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf45b4-b7c1-48c6-873c-716a0339c793 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.699572 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf45b4-b7c1-48c6-873c-716a0339c793 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.699714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba07bbd-6455-4b14-ab7e-36f43985a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:07.700249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf45b4-b7c1-48c6-873c-716a0339c793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:07.700449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07bbd-6455-4b14-ab7e-36f43985a1d8 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.700670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf45b4-b7c1-48c6-873c-716a0339c793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:07.700816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07bbd-6455-4b14-ab7e-36f43985a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.700964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07bbd-6455-4b14-ab7e-36f43985a1d8 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.701895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba07bbd-6455-4b14-ab7e-36f43985a1d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:07.702048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf45b4-b7c1-48c6-873c-716a0339c793 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:07.703746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba07bbd-6455-4b14-ab7e-36f43985a1d8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:07.718522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 239/471] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:07.719928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4d70-ec1e-4038-9a28-60355226e7e2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:07.720219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4d70-ec1e-4038-9a28-60355226e7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:07.720524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4d70-ec1e-4038-9a28-60355226e7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:07.737233 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 233/472] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:17:07 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:17:07.739046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba07bbd-6455-4b14-ab7e-36f43985a1d8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:07.741897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:07.762209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5a8f4d70-ec1e-4038-9a28-60355226e7e2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:07.764279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5a8f4d70-ec1e-4038-9a28-60355226e7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:07.875257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 240/473] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:07.876573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f4d70-ec1e-4038-9a28-60355226e7e2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:07.995777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba07bbd-6455-4b14-ab7e-36f43985a1d8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:08.009066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f4d70-ec1e-4038-9a28-60355226e7e2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:08.029022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:08.057017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83463e4-e7a6-4180-81ea-d91cdd376223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:08.058073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83463e4-e7a6-4180-81ea-d91cdd376223 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:08.059328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83463e4-e7a6-4180-81ea-d91cdd376223 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:08.059922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83463e4-e7a6-4180-81ea-d91cdd376223 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:08.060900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83463e4-e7a6-4180-81ea-d91cdd376223 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:08.062642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83463e4-e7a6-4180-81ea-d91cdd376223 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:08.092417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 241/474] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:17:07 2022] POST /identity/v3/users => generated 249 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:17:08.145497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:08.146796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:08.147390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:08.147866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:08.167535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:08.169680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:08.188968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:08.190138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:08.191773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:08.191773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:08.191773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:08.194344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 234/475] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:08.204095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83463e4-e7a6-4180-81ea-d91cdd376223 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:08.310639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:08.411996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83463e4-e7a6-4180-81ea-d91cdd376223 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:08.465283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:08.494061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:08.496722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:08.498426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:08.499252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:08.501839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:08.502818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:08.507263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:08.537630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10866483-f3b4-446b-bb70-e63eae14383b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:08.547160 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 242/476] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:08.556725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:08.583509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:08.584005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:08.584282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:08.584604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:08.585296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:08.586803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:08.596439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.sql.core [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 12:17:08.596439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 12:17:08.596439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [parameters: {'id': '1b40368ac8564d0b8165e4ffb76ac05a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 12:17:08.596439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81433) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 12:17:08.611569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Sep 13 12:17:08.616958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:17:08.618591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application yield resource Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise self.value Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application session.commit() Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 12:17:08.620230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.flush() Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application compat.raise_( Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 12:17:08.622532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:17:08.624962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:17:08.628318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [parameters: {'id': '1b40368ac8564d0b8165e4ffb76ac05a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:08.632737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 12:17:08.638576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:08.641836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 235/477] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Sep 13 12:17:08 2022] POST /identity/v3/roles => generated 144 bytes in 309 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:08.641836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:08.767034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee9d6-dcaa-4d00-a7bb-6e167db9de41 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:08.789764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:08.794425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44150a61-e7a7-4c01-aee4-0e575b93f18c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:08.815425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13c26-c8bf-4ece-ab97-60279f04ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:08.816812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13c26-c8bf-4ece-ab97-60279f04ff07 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:08.817281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13c26-c8bf-4ece-ab97-60279f04ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:08.817749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13c26-c8bf-4ece-ab97-60279f04ff07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:08.843162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e13c26-c8bf-4ece-ab97-60279f04ff07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-00e13c26-c8bf-4ece-ab97-60279f04ff07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:08.854409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:08.856140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:08.857672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 236/478] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:17:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:08.867425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13c26-c8bf-4ece-ab97-60279f04ff07 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:08.874559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0fbc-ac70-4a4c-aef5-54ee5b0d5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:08.876101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0fbc-ac70-4a4c-aef5-54ee5b0d5133 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:08.876877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0fbc-ac70-4a4c-aef5-54ee5b0d5133 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:08.877909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0fbc-ac70-4a4c-aef5-54ee5b0d5133 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:08.879520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0fbc-ac70-4a4c-aef5-54ee5b0d5133 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:08.882655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0fbc-ac70-4a4c-aef5-54ee5b0d5133 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:08.936673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 243/479] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:17:08 2022] POST /identity/v3/users => generated 248 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:17:09.059464 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13c26-c8bf-4ece-ab97-60279f04ff07 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:09.114899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265e4d0-cda0-4ede-b273-68120a3ccbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:09.115535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e4d0-cda0-4ede-b273-68120a3ccbaa None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:09.115807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e4d0-cda0-4ede-b273-68120a3ccbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:09.116077 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265e4d0-cda0-4ede-b273-68120a3ccbaa None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:09.116881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265e4d0-cda0-4ede-b273-68120a3ccbaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:09.117182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265e4d0-cda0-4ede-b273-68120a3ccbaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:09.118611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265e4d0-cda0-4ede-b273-68120a3ccbaa None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:09.134155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 237/480] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:10.795940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca40211-5d92-4425-b9cf-eb2957f5764a None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:10.796818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca40211-5d92-4425-b9cf-eb2957f5764a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:10.796818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca40211-5d92-4425-b9cf-eb2957f5764a None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:10.798229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 244/481] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:10.811735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74b1c-3d89-4070-bc60-8c3de670345d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:10.813299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74b1c-3d89-4070-bc60-8c3de670345d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:10.814065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74b1c-3d89-4070-bc60-8c3de670345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:10.862892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-13e74b1c-3d89-4070-bc60-8c3de670345d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:10.865266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-13e74b1c-3d89-4070-bc60-8c3de670345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:10.930732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:11.001751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 238/482] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:11.299154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca40211-5d92-4425-b9cf-eb2957f5764a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:11.474796 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:11.511412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca40211-5d92-4425-b9cf-eb2957f5764a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:11.597322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1fd67-f425-4f78-903b-ad26d3eacb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:11.597940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1fd67-f425-4f78-903b-ad26d3eacb44 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:11.598397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1fd67-f425-4f78-903b-ad26d3eacb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:11.598850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1fd67-f425-4f78-903b-ad26d3eacb44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:11.628762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1fd67-f425-4f78-903b-ad26d3eacb44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c0f1fd67-f425-4f78-903b-ad26d3eacb44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:11.636861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:11.638609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:11.640096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 245/483] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:11.645876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e74b1c-3d89-4070-bc60-8c3de670345d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:11.811448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e74b1c-3d89-4070-bc60-8c3de670345d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:11.857428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9abf-f7e5-498b-bd62-68ab8ae69074 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:11.859055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9abf-f7e5-498b-bd62-68ab8ae69074 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:11.859794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9abf-f7e5-498b-bd62-68ab8ae69074 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:11.863262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 246/484] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:17:11.871672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c837c1-ad1e-4671-adbf-ee09932c8b9b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:11.872666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c837c1-ad1e-4671-adbf-ee09932c8b9b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:11.873856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c837c1-ad1e-4671-adbf-ee09932c8b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:11.884914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:11.886979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:11.887721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:11.888940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:11.892241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:11.893213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:11.899124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:11.928082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 239/485] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:11.932797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-20c837c1-ad1e-4671-adbf-ee09932c8b9b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:11.934483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-20c837c1-ad1e-4671-adbf-ee09932c8b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:11.935735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:12.007400 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:12.091091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 247/486] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:12.092969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703580-9492-4540-b7a1-4f7e817d0a89 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:12.093502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703580-9492-4540-b7a1-4f7e817d0a89 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:12.093972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703580-9492-4540-b7a1-4f7e817d0a89 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:12.096814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 248/487] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:12.114229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55b9f-163f-4c88-81b3-844e4d019d16 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:12.114871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55b9f-163f-4c88-81b3-844e4d019d16 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:12.115340 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55b9f-163f-4c88-81b3-844e4d019d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:12.138413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679f131-7db4-4fef-adfe-6dabbab7ef65 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:12.161311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-acf55b9f-163f-4c88-81b3-844e4d019d16 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:12.162945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-acf55b9f-163f-4c88-81b3-844e4d019d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:12.188340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:12.189044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:12.189302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:12.189567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:12.215694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:12.217244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:12.245101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:12.246085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:12.246903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:12.246903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:12.246903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:12.251102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 240/488] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:12.252574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:12.265926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:12.276468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 249/489] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:12.392284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:12.417642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abecc6-03e1-418b-a12e-bb4840b61f0f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:12.463388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:12.464023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:12.464298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:12.464605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:12.468270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:12.468612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:12.470113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:12.486531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 241/490] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:12.492615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55b9f-163f-4c88-81b3-844e4d019d16 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:12.546974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:12.674067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dc5d4-2f88-4650-b66c-c7f19e913152 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:12.717598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fce33-9c74-48d0-9961-56a92b3568b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:12.718269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fce33-9c74-48d0-9961-56a92b3568b5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:12.718543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fce33-9c74-48d0-9961-56a92b3568b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:12.718812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fce33-9c74-48d0-9961-56a92b3568b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:12.732297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fce33-9c74-48d0-9961-56a92b3568b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-338fce33-9c74-48d0-9961-56a92b3568b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:12.737928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:12.739652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:12.741298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 242/491] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:12.747143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fce33-9c74-48d0-9961-56a92b3568b5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:12.750200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:12.764580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55b9f-163f-4c88-81b3-844e4d019d16 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:12.812788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:12.813548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:12.813815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:12.814083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:12.828282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:12.829840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:12.848782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:12.849779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:12.850656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:12.855596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 250/492] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:17:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:12.856668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:12.887779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fce33-9c74-48d0-9961-56a92b3568b5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:12.931179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb110cf-dfd1-4a57-b84b-ddd0f3117f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:12.932064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb110cf-dfd1-4a57-b84b-ddd0f3117f00 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:12.932345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb110cf-dfd1-4a57-b84b-ddd0f3117f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:12.932749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb110cf-dfd1-4a57-b84b-ddd0f3117f00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:12.936254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:12.945601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb110cf-dfd1-4a57-b84b-ddd0f3117f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-6fb110cf-dfd1-4a57-b84b-ddd0f3117f00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:12.950559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:12.951487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:12.952276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 243/493] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:12.952961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb110cf-dfd1-4a57-b84b-ddd0f3117f00 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:12.992341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa86462-58a0-4466-9b8d-d2aa97a05566 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:13.032840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554d6fd-be55-4f3b-819d-5863436d4bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:13.033461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554d6fd-be55-4f3b-819d-5863436d4bbb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.033768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554d6fd-be55-4f3b-819d-5863436d4bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.034034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554d6fd-be55-4f3b-819d-5863436d4bbb None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.034768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554d6fd-be55-4f3b-819d-5863436d4bbb None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:13.035242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554d6fd-be55-4f3b-819d-5863436d4bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:13.036102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:13.037921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554d6fd-be55-4f3b-819d-5863436d4bbb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:13.051632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 251/494] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:13.053683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402708a-0326-4f4e-b6e2-5a62764b9f39 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.054150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402708a-0326-4f4e-b6e2-5a62764b9f39 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.054607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402708a-0326-4f4e-b6e2-5a62764b9f39 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.057652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 252/495] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:13.061462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402708a-0326-4f4e-b6e2-5a62764b9f39 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:13.107237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb110cf-dfd1-4a57-b84b-ddd0f3117f00 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:13.171549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:13.172554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.172878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.173167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.174118 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:13.174660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:13.176923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:13.239697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 244/496] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:17:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:13.240872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:13.254680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402708a-0326-4f4e-b6e2-5a62764b9f39 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:13.291200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:13.311270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3924d9-03d2-40c2-a11f-ad7e92c489ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:13.312250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3924d9-03d2-40c2-a11f-ad7e92c489ec None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.312794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3924d9-03d2-40c2-a11f-ad7e92c489ec None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.313286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3924d9-03d2-40c2-a11f-ad7e92c489ec None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.314490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3924d9-03d2-40c2-a11f-ad7e92c489ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:13.315068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3924d9-03d2-40c2-a11f-ad7e92c489ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:13.317819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3924d9-03d2-40c2-a11f-ad7e92c489ec None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:13.334067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 253/497] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:13.336164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a671d5-b939-4004-9966-d97d0ea4f5fa None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.337023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a671d5-b939-4004-9966-d97d0ea4f5fa None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.337166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a671d5-b939-4004-9966-d97d0ea4f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.367190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c3a671d5-b939-4004-9966-d97d0ea4f5fa None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:13.369288 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c3a671d5-b939-4004-9966-d97d0ea4f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:13.390272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82414-024e-4c5f-b94d-10321984145c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:13.420632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:13.434788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68bc0-8563-4fbb-a979-234094b8412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:13.435445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68bc0-8563-4fbb-a979-234094b8412d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.435714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68bc0-8563-4fbb-a979-234094b8412d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.435979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68bc0-8563-4fbb-a979-234094b8412d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.447550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff68bc0-8563-4fbb-a979-234094b8412d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:13.449117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff68bc0-8563-4fbb-a979-234094b8412d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:13.453893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 254/498] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:13.454770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a671d5-b939-4004-9966-d97d0ea4f5fa None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-aff68bc0-8563-4fbb-a979-234094b8412d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:13.468900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:13.470589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:13.472282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:13.472282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:13.472282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:13.472282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 245/499] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:13.472725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484ef1-59d3-405a-9dbd-58b32b8ae253 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.473605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484ef1-59d3-405a-9dbd-58b32b8ae253 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.473605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484ef1-59d3-405a-9dbd-58b32b8ae253 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.476642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 246/500] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:13.478294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484ef1-59d3-405a-9dbd-58b32b8ae253 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:13.577772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a671d5-b939-4004-9966-d97d0ea4f5fa None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:13.602363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:13.638169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484ef1-59d3-405a-9dbd-58b32b8ae253 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:13.638423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0489d-ce4d-4c4a-a954-fa7b1cdc5d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:13.638822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0489d-ce4d-4c4a-a954-fa7b1cdc5d0b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.639101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0489d-ce4d-4c4a-a954-fa7b1cdc5d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.639369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0489d-ce4d-4c4a-a954-fa7b1cdc5d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.680597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:13.681360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.681633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.682023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.695025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:13.696723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:13.714513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:13.715944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:13.718258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:13.718258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:13.718258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:13.718258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 247/501] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:13.718258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:13.750586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0489d-ce4d-4c4a-a954-fa7b1cdc5d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:13.752431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:13.753934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0489d-ce4d-4c4a-a954-fa7b1cdc5d0b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:13.840412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16d12-7310-4b70-b432-cf943988ca8e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:13.882092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:13.883137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.883642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.884127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.885368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:13.885924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:13.888675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:13.905611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 255/502] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:13.913536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 248/503] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:13.913739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5518-c4bc-4f26-805e-8286c182a98c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:13.913739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5518-c4bc-4f26-805e-8286c182a98c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:13.913902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:13.913989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5518-c4bc-4f26-805e-8286c182a98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:13.937818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-681e5518-c4bc-4f26-805e-8286c182a98c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:13.939150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-681e5518-c4bc-4f26-805e-8286c182a98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:13.948753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:14.027929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:14.034923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 256/504] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:14.035835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e5518-c4bc-4f26-805e-8286c182a98c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.049153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f756e-7c66-41c7-b996-c3d4ec280b4d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.105789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.106697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.107175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.107624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.108869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:14.109399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:14.112139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:14.134254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 249/505] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:14.135795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.206158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e5518-c4bc-4f26-805e-8286c182a98c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.259620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.260295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.260610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.260892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.275378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:14.276977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:14.279392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:14.296724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:14.298458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:14.300089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:14.300089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:14.300089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:14.304125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 257/506] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:14.304989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.315624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60cec9-4c81-44eb-83aa-483a362b18c0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.374856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.375617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.375903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.376295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.395340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:14.397265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:14.406120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:14.417511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:14.419264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:14.420470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:14.420470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:14.420470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:14.420470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 250/507] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:14.420470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.461982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ca85-dfde-4d72-bf74-12d9f7331bf6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.507940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.508730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.509073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.509411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.518370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:14.520140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:14.533640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:14.534987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 258/508] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:14.536716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.559526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5957f-059b-461c-9bf5-7cd51bf74146 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.603641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.604294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.604607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.604881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.614741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:14.616251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:14.621067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:14.631513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:14.632758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 251/509] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:14.635112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.697430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab738a6-3bc5-4c88-9e28-45e678f88ea0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.730602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:14.750911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.751915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.752477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.753348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.754365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:14.754929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:14.757560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:14.781544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 259/510] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:14.783071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.808644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8846ae-6433-4eb4-9e30-39e14acc7e74 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.853606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2cef9-a133-4317-8ec9-cff2646e0534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.854246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2cef9-a133-4317-8ec9-cff2646e0534 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.854518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2cef9-a133-4317-8ec9-cff2646e0534 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.854785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2cef9-a133-4317-8ec9-cff2646e0534 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.867721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2cef9-a133-4317-8ec9-cff2646e0534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b2d2cef9-a133-4317-8ec9-cff2646e0534 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:14.873172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:14.874104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:14.874881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 252/511] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:14.875526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2cef9-a133-4317-8ec9-cff2646e0534 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.921714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed7119-dacf-4983-806a-8bd881d3b04d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.942881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:14.977708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.978664 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.979117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.979563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.980692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:14.981195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:14.983629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:15.006339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 260/512] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:15.007484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:15.027874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2cef9-a133-4317-8ec9-cff2646e0534 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:15.054149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:15.077717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:15.078378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:15.078685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:15.078957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:15.079711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:15.080022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:15.081951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:15.109272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 253/513] 10.222.0.55 () {56 vars in 1139 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:15.110797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:15.145343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629601-7b3b-4403-ac35-7ecd5559d5c8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:15.188852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:15.189414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:15.189663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:15.190070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:15.191641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:15.191954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:15.193480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:15.235355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 261/514] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Sep 13 12:17:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:15.236260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:15.252306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b5d1-6823-4683-b4da-a6086e8db6f4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:15.278072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:15.303169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462545-f3a2-4f39-a83f-11aa2909b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:15.303935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462545-f3a2-4f39-a83f-11aa2909b41f None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:15.304297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462545-f3a2-4f39-a83f-11aa2909b41f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:15.304692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462545-f3a2-4f39-a83f-11aa2909b41f None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:15.305478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462545-f3a2-4f39-a83f-11aa2909b41f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:15.307146 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462545-f3a2-4f39-a83f-11aa2909b41f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:15.336152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 254/515] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:17:15 2022] POST /identity/v3/users => generated 247 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:17:15.337356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462545-f3a2-4f39-a83f-11aa2909b41f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:15.392550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:15.395870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a383-0bf0-4e70-982f-1c1fd3e91682 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:15.473007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:15.474047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:15.474550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:15.475023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:15.476315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:15.476929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:15.479908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:15.497745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 262/516] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:15.499126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:15.524574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462545-f3a2-4f39-a83f-11aa2909b41f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:15.581455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:15.581455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:15.581875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:15.581875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:15.589839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:15.591876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:15.613102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:15.614060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:15.615090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:15.615090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:15.615090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:15.615090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:15.615090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:15.615090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:15.615090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:15.615090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:15.615525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 255/517] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:15.616977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:15.689676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:15.700965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b45dc-e0cf-4425-afe9-abf61cf78d19 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:15.747781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74064d3-9305-43ed-b6a5-c2cc4ba328d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:15.748628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74064d3-9305-43ed-b6a5-c2cc4ba328d3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:15.748918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74064d3-9305-43ed-b6a5-c2cc4ba328d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:15.749219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74064d3-9305-43ed-b6a5-c2cc4ba328d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:15.767194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:15.781965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9a73-92d9-4917-a3a9-23680547de24 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:15.829578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89f98-2917-48af-98d8-cb5e71317efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:15.830574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89f98-2917-48af-98d8-cb5e71317efe None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:15.830988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89f98-2917-48af-98d8-cb5e71317efe None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:15.831467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89f98-2917-48af-98d8-cb5e71317efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:15.841163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74064d3-9305-43ed-b6a5-c2cc4ba328d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:15.842776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74064d3-9305-43ed-b6a5-c2cc4ba328d3 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:15.929843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d89f98-2917-48af-98d8-cb5e71317efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:15.931698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d89f98-2917-48af-98d8-cb5e71317efe None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:15.972102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:15.985277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 263/518] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:15.986817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74064d3-9305-43ed-b6a5-c2cc4ba328d3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:16.060224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:16.074150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 256/519] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:16.075144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89f98-2917-48af-98d8-cb5e71317efe None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:16.152266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74064d3-9305-43ed-b6a5-c2cc4ba328d3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:16.198995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:16.199971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:16.200450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:16.200917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:16.215058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:16.217033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:16.235360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:16.236497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:16.237509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:16.237509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:16.237509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:16.243487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 264/520] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:16.243487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:16.269498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89f98-2917-48af-98d8-cb5e71317efe None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:16.301707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:16.327080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:16.328071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:16.328610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:16.329076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:16.330333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:16.330915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:16.333730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:16.371798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 257/521] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:16.371798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:16.375502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037572-4aa5-4b12-a676-9d4330c2f0fb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:16.417481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:16.418145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:16.418459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:16.418725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:16.433138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:16.434730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:16.453018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:16.454728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:16.457173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:16.457173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:16.457173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:16.457173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 265/522] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:16.457173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:16.473066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:16.556205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e640-d04b-436a-a2de-daf86a3c25dc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:16.602560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:16.603145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:16.603427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:16.603690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:16.612133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:16.616718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:16.618268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:16.619629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1114c7-612f-4700-8efb-13324842daee None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:16.636075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:16.643028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:16.643991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:16.643991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:16.643991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:16.643991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 258/523] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:16.643991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:16.686682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:16.687524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:16.687809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:16.688666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:16.689924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:16.690464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:16.693098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:16.719869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 266/524] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:16.719869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:16.774944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fbe1c-808d-458f-af9d-f7190b5417d2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:16.778537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:16.835028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:16.835671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:16.835951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:16.836204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:16.837253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=536e042f0d76408b9379af15526878b3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:16.837627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:16.839114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:16.847060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 259/525] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:16 2022] GET /identity/v3/role_assignments?user.id=536e042f0d76408b9379af15526878b3&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:16.858231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:16.887842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436fc43-b9d4-4fe4-bfdd-68b8bad37d06 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:16.972545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:16.974927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:16.975668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:16.976363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:16.978414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:16.979285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:16.982308 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:17.013661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0344-b029-4fea-ac00-fbc3c6e1e3a1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:17.014599 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 267/526] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:17.016646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:17.056888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:17.057671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:17.058007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:17.058338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:17.059082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:17.059609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:17.061031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:17.062952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:17.078011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 260/527] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:17.083706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:17.119836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:17.210468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99640a-5cd7-4e97-b474-7d158efb8c20 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:17.244053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8a632-cb41-4feb-9273-1451c528be30 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:17.252168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:17.253035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:17.253315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:17.253586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:17.261743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:17.263302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:17.277384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:17.278861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:17.280273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:17.280273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:17.280273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:17.280273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:17.280273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:17.280273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:17.280273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:17.280273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:17.283407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 261/528] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:17.284724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:17.314522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:17.316712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:17.317607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:17.318362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:17.336885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:17.342011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:17.361826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:17.363565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:17:17.365233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:17.368103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 268/529] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:17.369175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:17.429940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:17.445607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dfc3b-6674-4938-b413-2b30d2c9e2f8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:17.490324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:17.491033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:17.491311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:17.491586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:17.499562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:17.501101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:17.512902 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:17.515900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:17.520751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:17.521642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:17.521642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:17.521642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:17.521642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:17.521642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:17.521642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:17.521642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:17.521642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:17.524739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 262/530] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:17.526516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:17.567666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a442a-bde6-4078-83e1-a1aa086b90fd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:17.635329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:17.636457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:17.637017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:17.637568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:17.638702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:17.639201 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:17.641758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:17.654238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dde77a-3a9f-41d9-8da2-c0e2a02b9da9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:17.681399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 269/531] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:17.681399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:17.726852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:17.728176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:17.728644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:17.729071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:17.731483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:17.732049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:17.734950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:17.778254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 263/532] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Sep 13 12:17:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:17.780426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:17.804149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:17.867801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb53fd4-d284-4be6-ba55-985e5f34f953 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:17.935482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:17.936522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:17.937992 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:17.938477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:17.939805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:17.940358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:17.945568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:17.965145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:17.976693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3861-d80a-4734-bffd-776e51473e5f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:17.984929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 270/533] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:17.984929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:18.028669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:18.029761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:18.030263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:18.030728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:18.031752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=b310f17f81e040ac80dc1b9de52026f4) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:18.032497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:18.034375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:18.048975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 264/534] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:17 2022] GET /identity/v3/role_assignments?user.id=b310f17f81e040ac80dc1b9de52026f4&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:18.050525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:18.204880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccecdb-538f-49b6-ba8b-36dcfa552763 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:18.239902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:18.294840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240c1d-3389-49ff-a2fb-c40bc84114af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:18.295894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240c1d-3389-49ff-a2fb-c40bc84114af None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:18.296411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240c1d-3389-49ff-a2fb-c40bc84114af None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:18.297749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240c1d-3389-49ff-a2fb-c40bc84114af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:18.330198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03141b64-c9fc-4cfb-8bf1-ec723d14679c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:18.403689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c6c6-700f-4cc4-9b0c-da119b4e7b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:18.404805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c6c6-700f-4cc4-9b0c-da119b4e7b7a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:18.405283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c6c6-700f-4cc4-9b0c-da119b4e7b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:18.405761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c6c6-700f-4cc4-9b0c-da119b4e7b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:18.407132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c6c6-700f-4cc4-9b0c-da119b4e7b7a None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=b7b8243a35594402943d956a93cda7b3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:18.407683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c6c6-700f-4cc4-9b0c-da119b4e7b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:18.410162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c6c6-700f-4cc4-9b0c-da119b4e7b7a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:18.425819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 265/535] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:18 2022] GET /identity/v3/role_assignments?user.id=b7b8243a35594402943d956a93cda7b3&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 259 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:18.429592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0e91-f90d-4181-9b2a-6d9f0afbb3fb None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:18.430724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0e91-f90d-4181-9b2a-6d9f0afbb3fb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:18.431533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0e91-f90d-4181-9b2a-6d9f0afbb3fb None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:18.436498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 266/536] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:18.449593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5256f-fc75-4dad-abce-1ab64a32dfb3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:18.449929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5256f-fc75-4dad-abce-1ab64a32dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:18.450148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5256f-fc75-4dad-abce-1ab64a32dfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:18.472361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:18.480484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc240c1d-3389-49ff-a2fb-c40bc84114af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:18.483629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc240c1d-3389-49ff-a2fb-c40bc84114af None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:18.497739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-38c5256f-fc75-4dad-abce-1ab64a32dfb3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:18.499056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-38c5256f-fc75-4dad-abce-1ab64a32dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:18.669424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 267/537] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:18.789365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 271/538] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:18.801595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5256f-fc75-4dad-abce-1ab64a32dfb3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:18.909628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:18.966792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5256f-fc75-4dad-abce-1ab64a32dfb3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:19.012413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:19.013082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:19.013353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:19.013615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:19.026330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:19.027818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:19.054567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:19.056343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:19.058126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:19.058126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:19.058126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:19.058126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 268/539] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:19.062815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240c1d-3389-49ff-a2fb-c40bc84114af None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:19.205985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:19.258559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:19.266054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240c1d-3389-49ff-a2fb-c40bc84114af None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:19.316485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:19.317529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:19.317987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:19.318750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:19.319931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:19.320537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:19.323365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:19.378614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 272/540] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:19.384198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:19.468557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe185-3e6a-4e08-a3bf-cd732a807f75 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:19.495734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:19.552805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078e13d-12fb-4abb-b6c2-065bd77576b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:19.553993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e13d-12fb-4abb-b6c2-065bd77576b3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:19.555778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e13d-12fb-4abb-b6c2-065bd77576b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:19.556457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e13d-12fb-4abb-b6c2-065bd77576b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:19.580171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078e13d-12fb-4abb-b6c2-065bd77576b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d078e13d-12fb-4abb-b6c2-065bd77576b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:19.589856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:19.590806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:19.591618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 269/541] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:19.602094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078e13d-12fb-4abb-b6c2-065bd77576b3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:19.632988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191694c9-edec-4b07-9ee9-057b49e9dbe2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:19.715849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:19.717036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:19.717607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:19.718092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:19.726663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078e13d-12fb-4abb-b6c2-065bd77576b3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:19.734541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:19.737567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:19.768178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:19.769047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:19.769333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:19.769602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:19.770341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:19.770645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:19.772074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:19.783323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 270/542] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:19.788887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:19.789817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:19.790657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 273/543] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:19.791988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:19.799633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:19.853018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:19.855808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:19.933170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc0cf2-21c4-4a3d-ad22-5b8aa14703c1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:19.977305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:19.978027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:19.978305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:19.978571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:20.004537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:20.007399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:20.056968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:20.057975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:20.058791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:20.058791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:20.058791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:20.060325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 271/544] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:20.072237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:20.156717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e0839-339d-4f08-8711-571b0d35c7c1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:20.279860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:20.284680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:20.285382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:20.285664 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:20.288432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:20.288432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:20.288432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:20.289989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:20.314164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892779-b2cd-4965-a577-15a7d39b5108 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:20.318808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 274/545] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:20.325407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:20.397113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:20.397747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:20.398026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:20.398295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:20.399307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:20.399607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:20.401073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:20.429955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 272/546] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:20.439048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:20.552558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa34bff-ad6b-4fdf-8753-1b17cb66efe5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:20.563536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d009b-0ef2-4a73-9d04-b5807baff97c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:20.569044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:20.592600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b652ae6-fe68-4344-a948-fc6596f67e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:20.593275 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b652ae6-fe68-4344-a948-fc6596f67e0c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:20.593555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b652ae6-fe68-4344-a948-fc6596f67e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:20.593829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b652ae6-fe68-4344-a948-fc6596f67e0c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:20.602943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b652ae6-fe68-4344-a948-fc6596f67e0c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:20.604571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b652ae6-fe68-4344-a948-fc6596f67e0c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-4b652ae6-fe68-4344-a948-fc6596f67e0c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:20.617876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:20.619057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:20.619965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 273/547] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:20.621087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068688b-7e32-4236-acbe-f9dc0d3fb63d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:20.621219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068688b-7e32-4236-acbe-f9dc0d3fb63d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:20.621401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068688b-7e32-4236-acbe-f9dc0d3fb63d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:20.622723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 274/548] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:20.629006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e874b-2688-4b17-9c0e-a8a9f8d41f4c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:20.629342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e874b-2688-4b17-9c0e-a8a9f8d41f4c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:20.629555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e874b-2688-4b17-9c0e-a8a9f8d41f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:20.633185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:20.634231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:20.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:20.635294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:20.636843 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=ac7ccabe29f4464bafbdd7b5aab7d775) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:20.638539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:20.640268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:20.649344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 275/549] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:20 2022] GET /identity/v3/role_assignments?user.id=ac7ccabe29f4464bafbdd7b5aab7d775&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:20.650546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:20.657786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ba5e874b-2688-4b17-9c0e-a8a9f8d41f4c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:20.659106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ba5e874b-2688-4b17-9c0e-a8a9f8d41f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:20.670732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:20.799742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226f90-5db1-4879-90dd-8ba9adf17c39 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:20.853089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:20.854178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:20.854713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:20.855203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:20.857251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:20.857891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:20.859733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:20.881939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:20.890766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 276/550] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Sep 13 12:17:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:20.900020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:20.918824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 275/551] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:21.035988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b519-f914-454a-9c47-79cbcf305482 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:21.062234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9c1c-094f-44d6-91f8-ba5252478833 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:21.062626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9c1c-094f-44d6-91f8-ba5252478833 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:21.063107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9c1c-094f-44d6-91f8-ba5252478833 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:21.066143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 276/552] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:21.072991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba4884-8092-4471-8cea-9e9f70fb013e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:21.073476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba4884-8092-4471-8cea-9e9f70fb013e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:21.073973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba4884-8092-4471-8cea-9e9f70fb013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:21.079688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abaa51-764b-4808-97bd-ef06246c9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:21.080376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abaa51-764b-4808-97bd-ef06246c9c24 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:21.080701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abaa51-764b-4808-97bd-ef06246c9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:21.080971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abaa51-764b-4808-97bd-ef06246c9c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:21.158319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-63ba4884-8092-4471-8cea-9e9f70fb013e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:21.160630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-63ba4884-8092-4471-8cea-9e9f70fb013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:21.167515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abaa51-764b-4808-97bd-ef06246c9c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:21.168960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abaa51-764b-4808-97bd-ef06246c9c24 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:21.173045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:21.291264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 277/553] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:21.304522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abaa51-764b-4808-97bd-ef06246c9c24 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:21.420128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 277/554] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:21.429191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba4884-8092-4471-8cea-9e9f70fb013e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:21.572670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:21.585493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abaa51-764b-4808-97bd-ef06246c9c24 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:21.656828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:21.658003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:21.660867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:21.661363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:21.661866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:21.685635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:21.688180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:21.719636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:21.720644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:21.721590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:21.721590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:21.721590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:21.722474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 278/555] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:21.731601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:21.767724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba4884-8092-4471-8cea-9e9f70fb013e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:21.899243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31ab3-c1e6-433d-8b84-f0804e7df27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:21.900294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31ab3-c1e6-433d-8b84-f0804e7df27f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:21.900799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31ab3-c1e6-433d-8b84-f0804e7df27f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:21.901241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31ab3-c1e6-433d-8b84-f0804e7df27f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:21.944987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b059-b876-4ad4-a6eb-82af7f54b919 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:21.951814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f31ab3-c1e6-433d-8b84-f0804e7df27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-14f31ab3-c1e6-433d-8b84-f0804e7df27f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:21.968429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:21.970263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:21.972124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 278/556] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 543 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:21.982445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31ab3-c1e6-433d-8b84-f0804e7df27f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:22.001086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:22.002200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:22.002671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:22.003160 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:22.004439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:22.005000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:22.008645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:22.055739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 279/557] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:22.066719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:22.100857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:22.239471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31ab3-c1e6-433d-8b84-f0804e7df27f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:22.298647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf159c54-ac09-48a3-837c-199e0ed897e7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:22.299288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:22.310075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:22.311164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:22.311460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:22.311743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:22.312765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:22.312765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:22.314229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:22.324939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 279/558] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:22.325931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:22.371438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09778bd-e565-4ed2-850f-2bf6a49a15ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:22.372566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09778bd-e565-4ed2-850f-2bf6a49a15ca None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:22.373058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09778bd-e565-4ed2-850f-2bf6a49a15ca None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:22.373552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09778bd-e565-4ed2-850f-2bf6a49a15ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:22.386777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09778bd-e565-4ed2-850f-2bf6a49a15ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:22.389578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09778bd-e565-4ed2-850f-2bf6a49a15ca None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a09778bd-e565-4ed2-850f-2bf6a49a15ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:22.412994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:22.414906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:22.417025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 280/559] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:22.418660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f76ba-82fb-43bb-a60d-a84b3f8822be None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:22.418660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f76ba-82fb-43bb-a60d-a84b3f8822be None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:22.418660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f76ba-82fb-43bb-a60d-a84b3f8822be None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:22.427302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 281/560] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:22.427302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f76ba-82fb-43bb-a60d-a84b3f8822be None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:22.475125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840f7e2-506e-4dd6-a3ec-07db06d77143 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:22.521047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee8dce-03a0-43e7-af90-cb6db636f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:22.521634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8dce-03a0-43e7-af90-cb6db636f9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:22.521934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8dce-03a0-43e7-af90-cb6db636f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:22.522194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8dce-03a0-43e7-af90-cb6db636f9e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:22.543051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee8dce-03a0-43e7-af90-cb6db636f9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f4ee8dce-03a0-43e7-af90-cb6db636f9e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:22.552757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:22.554471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:22.558451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 280/561] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:22.560126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee8dce-03a0-43e7-af90-cb6db636f9e9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:22.567462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:22.614382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f76ba-82fb-43bb-a60d-a84b3f8822be None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:22.665086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5505e-e01f-4849-91a8-daa4e8a32b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:22.665940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5505e-e01f-4849-91a8-daa4e8a32b2a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:22.666487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5505e-e01f-4849-91a8-daa4e8a32b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:22.666946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5505e-e01f-4849-91a8-daa4e8a32b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:22.678581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:22.684635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5505e-e01f-4849-91a8-daa4e8a32b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:22.686761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5505e-e01f-4849-91a8-daa4e8a32b2a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-04e5505e-e01f-4849-91a8-daa4e8a32b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:22.706234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:22.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:22.710827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:22.710827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:22.710827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:22.710827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 282/562] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:22.710827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1efd1b-0636-4cd3-b961-42c289f33af0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:22.710827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1efd1b-0636-4cd3-b961-42c289f33af0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:22.710827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1efd1b-0636-4cd3-b961-42c289f33af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:22.730099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6e1efd1b-0636-4cd3-b961-42c289f33af0 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:22.731347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6e1efd1b-0636-4cd3-b961-42c289f33af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:22.783718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee8dce-03a0-43e7-af90-cb6db636f9e9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:22.814172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 283/563] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:22.815418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1efd1b-0636-4cd3-b961-42c289f33af0 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:22.853372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:22.854423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:22.854962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:22.855487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:22.857994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:22.858384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:22.861057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:22.885357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 281/564] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:22.886782 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:22.904790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:22.968439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1efd1b-0636-4cd3-b961-42c289f33af0 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:23.018193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:23.019891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:23.020432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:23.020916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:23.022194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:23.022744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:23.024992 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:23.041882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 284/565] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:23.042543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:23.077656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29dd73-b4bf-4b08-af90-b9c8c5c0ce2f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:23.097951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:23.124715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:23.125392 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:23.125677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:23.125922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:23.126596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:23.126896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:23.128547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:23.149488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 282/566] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:23.149981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:23.263801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29827-d0bc-4bd5-971a-4e1f2728e43e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:23.277660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a68e0-9250-462e-a437-e8039ecacc35 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:23.300566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:23.324044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:23.325059 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:23.325524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:23.325930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:23.336810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:23.338095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:23.338578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:23.339142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:23.340612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=149aa4c99a33498282eb285ddebe89d5) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:23.341145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:23.342940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:23.343973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:23.347042 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:23.360000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 285/567] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:23 2022] GET /identity/v3/role_assignments?user.id=149aa4c99a33498282eb285ddebe89d5&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:23.360000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:23.377168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:23.378189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:23.379256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:23.379256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:23.379256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:23.379907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 283/568] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:23.381845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:23.433433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:23.558145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7784fb-ffc2-434e-81fc-232ae0093bd9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:23.606460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:23.607047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369588c4-8cc3-4c59-a19b-34386c875e91 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:23.607786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:23.608291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:23.608805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:23.618653 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:23.620725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:23.634803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:23.635826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:23.636969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:23.644658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 286/569] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:17:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:23.646015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:23.677244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8eabb-e373-4ddf-bf85-0a98ff87e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:23.678287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8eabb-e373-4ddf-bf85-0a98ff87e679 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:23.678793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8eabb-e373-4ddf-bf85-0a98ff87e679 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:23.679693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8eabb-e373-4ddf-bf85-0a98ff87e679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:23.694534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8eabb-e373-4ddf-bf85-0a98ff87e679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d4c8eabb-e373-4ddf-bf85-0a98ff87e679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:23.702163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:23.703203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:23.704035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:23.713054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 284/570] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:23.713054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8eabb-e373-4ddf-bf85-0a98ff87e679 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:23.726852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:23.846899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf19ee-b857-4c87-a72f-c76838b89ce2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:23.889169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:23.906368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:23.907457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:23.907929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:23.908538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:23.910700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:23.911226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:23.913862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:23.930626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8eabb-e373-4ddf-bf85-0a98ff87e679 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:23.934986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 287/571] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:23.936426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:23.992165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:23.992828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:23.993367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:23.993518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:23.994230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:23.995030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:23.996207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:24.021913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 285/572] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:17:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:24.022809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:24.124175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:24.129148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321fa5-c37f-4d4a-8ad7-c7b4243e5790 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:24.194795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9147d-347e-4021-877e-82c64ccc6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:24.196022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9147d-347e-4021-877e-82c64ccc6f17 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:24.196641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9147d-347e-4021-877e-82c64ccc6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:24.197183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9147d-347e-4021-877e-82c64ccc6f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:24.198351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9147d-347e-4021-877e-82c64ccc6f17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:24.198986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9147d-347e-4021-877e-82c64ccc6f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:24.201747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9147d-347e-4021-877e-82c64ccc6f17 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:24.219047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057130da-eb82-44ec-b367-2f6e75767f82 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:24.226850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 288/573] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:24.229553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9496cc-24ca-4e59-98d5-92d0b142c645 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:24.230023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9496cc-24ca-4e59-98d5-92d0b142c645 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:24.230495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9496cc-24ca-4e59-98d5-92d0b142c645 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:24.233604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 289/574] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:24.235113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9496cc-24ca-4e59-98d5-92d0b142c645 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:24.316118 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:24.317255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:24.317734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:24.319102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:24.340531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:24.343573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:24.366944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:24.368851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:17:24.370757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:24.375892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 286/575] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:24.378471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:24.383944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:24.439974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9496cc-24ca-4e59-98d5-92d0b142c645 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:24.509045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7de829-97fc-437d-aa7b-a5959f70e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:24.513552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de829-97fc-437d-aa7b-a5959f70e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:24.513990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de829-97fc-437d-aa7b-a5959f70e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:24.514926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de829-97fc-437d-aa7b-a5959f70e8a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:24.551131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7de829-97fc-437d-aa7b-a5959f70e8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:24.556180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7de829-97fc-437d-aa7b-a5959f70e8a4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-6c7de829-97fc-437d-aa7b-a5959f70e8a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:24.587356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:24.589425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:24.591143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:24.591143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:24.591143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:24.594108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 290/576] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:24.597131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd459c-44ca-491d-8b5e-3dd18255954c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:24.598001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd459c-44ca-491d-8b5e-3dd18255954c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:24.598765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd459c-44ca-491d-8b5e-3dd18255954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:24.609849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021324ad-e609-4ddc-8662-463b5187e39a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:24.631592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b6fd459c-44ca-491d-8b5e-3dd18255954c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:24.633355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b6fd459c-44ca-491d-8b5e-3dd18255954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:24.654322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:24.700761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:24.700761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:24.700761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:24.700761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:24.721806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:24.724990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:24.765951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:24.773150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:24.775317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:24.775317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:24.775317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:24.775317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 287/577] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:24.775317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:24.775880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 291/578] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:24.780797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd459c-44ca-491d-8b5e-3dd18255954c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:24.874103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:24.939739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd459c-44ca-491d-8b5e-3dd18255954c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:24.979901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad589-febb-4cba-aadf-ad7a1e894c28 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:24.980177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:24.980864 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:24.981185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:24.981461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:24.982134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:24.982458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:24.983880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:25.004444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 292/579] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:25.004444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:25.004444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:25.059702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:25.060352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:25.060670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:25.060903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:25.061654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:25.061957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:25.063451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:25.096037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 288/580] 10.222.0.55 () {56 vars in 1139 bytes} [Tue Sep 13 12:17:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:25.097768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:25.125504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25169f97-b25f-481c-ad41-e3e239715b53 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:25.180624 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:25.182020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:25.182303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:25.182629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:25.183524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:25.184001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:25.186422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:25.210826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 293/581] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:25.212239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:25.274630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bb49f-d014-4024-8534-e790bf0f44e9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:25.303127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:25.316182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:25.345489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:25.346660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:25.347147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:25.347625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:25.361034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:25.364300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:25.368652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be52b-a1fd-4956-879a-a128832978ea None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:25.387664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:25.389729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 289/582] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:25.391545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:25.421665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5b7a0-9b1c-45a0-9237-1cf535b861c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:25.422338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5b7a0-9b1c-45a0-9237-1cf535b861c5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:25.422649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5b7a0-9b1c-45a0-9237-1cf535b861c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:25.422920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5b7a0-9b1c-45a0-9237-1cf535b861c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:25.438266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5b7a0-9b1c-45a0-9237-1cf535b861c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-eaf5b7a0-9b1c-45a0-9237-1cf535b861c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:25.443941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:25.446683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 294/583] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:25.448304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5b7a0-9b1c-45a0-9237-1cf535b861c5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:25.561358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180099-cffc-4bdf-80c5-d6ddc423482e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:25.605481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:25.606137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:25.606422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:25.606706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:25.613059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5b7a0-9b1c-45a0-9237-1cf535b861c5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:25.620036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:25.621595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:25.638883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:25.641189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:25.643292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:25.643292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:25.643292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:25.643292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 290/584] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:25.643292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:25.672374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:25.684456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:25.697356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:25.698440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:25.698924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:25.699410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:25.714772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:25.716297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:25.730609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:25.741420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 295/585] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:25.743586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:25.835462 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62d5a5-effa-4bfb-92ce-c9ea25213001 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:25.878834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:25.879474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:25.879760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:25.880352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:25.880808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:25.881100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:25.882593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:25.891487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0ffa9-659a-4596-8de8-d4cb38efbfb1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:25.906112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 291/586] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:25.907596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:25.944745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:25.945386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:25.945668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:25.945943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:25.946640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:25.946947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:25.948425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:25.958491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 296/587] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:25.959380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:26.020430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:26.057689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:26.084808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613cf8f-fd70-4eff-93e1-47476a9b2d42 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:26.085126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b468-c52e-47f9-9417-84ac7fc43fd3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:26.125053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:26.125693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.125974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.126236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.127033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:26.127376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:26.128895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:26.135765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99e26-9ff2-4467-b990-6d1623e3c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:26.136440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99e26-9ff2-4467-b990-6d1623e3c223 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.136720 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99e26-9ff2-4467-b990-6d1623e3c223 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.136986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99e26-9ff2-4467-b990-6d1623e3c223 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.137657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99e26-9ff2-4467-b990-6d1623e3c223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:26.137957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99e26-9ff2-4467-b990-6d1623e3c223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:26.139412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99e26-9ff2-4467-b990-6d1623e3c223 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:26.149778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 297/588] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Sep 13 12:17:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:26.150648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:26.155958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 292/589] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:26.157936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d545-7df6-4760-90c9-c845c3974d8a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.158458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d545-7df6-4760-90c9-c845c3974d8a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.158905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d545-7df6-4760-90c9-c845c3974d8a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.161298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 293/590] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:26.162586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d545-7df6-4760-90c9-c845c3974d8a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:26.299945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352f437-8175-47bc-ad38-dac65ad81cc2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:26.304253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:26.304884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d545-7df6-4760-90c9-c845c3974d8a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:26.342472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825851c5-a053-464e-ba13-da2b85aa0077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:26.343163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825851c5-a053-464e-ba13-da2b85aa0077 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.343442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825851c5-a053-464e-ba13-da2b85aa0077 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.343716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825851c5-a053-464e-ba13-da2b85aa0077 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/536e042f0d76408b9379af15526878b3/roles/e45cf88b951c40d793eb810b5b33c8de` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.345109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:26.345866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.346159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.346431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.358811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:26.360318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:26.362256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825851c5-a053-464e-ba13-da2b85aa0077 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=536e042f0d76408b9379af15526878b3, role_id=e45cf88b951c40d793eb810b5b33c8de)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:26.363662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:26.364150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825851c5-a053-464e-ba13-da2b85aa0077 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:26.378177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:26.380007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:26.382149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:26.382149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:26.382149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:26.382149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 294/591] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:26.382149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:26.382690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 298/592] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:17:26 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/536e042f0d76408b9379af15526878b3/roles/e45cf88b951c40d793eb810b5b33c8de => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:17:26.382690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825851c5-a053-464e-ba13-da2b85aa0077 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:26.520685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f84fa-beb8-4824-b660-92b58a3d58c3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:26.552110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825851c5-a053-464e-ba13-da2b85aa0077 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:26.568683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52edd2-c5ab-47c7-a7e5-7e9fb97ffd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:26.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52edd2-c5ab-47c7-a7e5-7e9fb97ffd54 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.569811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52edd2-c5ab-47c7-a7e5-7e9fb97ffd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.570152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52edd2-c5ab-47c7-a7e5-7e9fb97ffd54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.584312 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52edd2-c5ab-47c7-a7e5-7e9fb97ffd54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:26.585968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52edd2-c5ab-47c7-a7e5-7e9fb97ffd54 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-0d52edd2-c5ab-47c7-a7e5-7e9fb97ffd54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:26.604973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:26.606214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:26.607286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:26.607286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:26.607286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:26.613025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 295/593] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:26.613025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475aac4-10cb-4cbb-b726-a5555b170486 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.613025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475aac4-10cb-4cbb-b726-a5555b170486 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.613025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475aac4-10cb-4cbb-b726-a5555b170486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.630793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:26.632034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.632643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.633202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.641756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6475aac4-10cb-4cbb-b726-a5555b170486 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:26.644952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6475aac4-10cb-4cbb-b726-a5555b170486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:26.646117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:26.649411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:26.664665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:26.666436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 299/594] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:26.669254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:26.703132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:26.743564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:26.794443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 296/595] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:26.796321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475aac4-10cb-4cbb-b726-a5555b170486 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:26.884488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae8775-32e1-4c21-a23f-495c782784f4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:26.966297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:26.967317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:26.967787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:26.968229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:26.969990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:26.970490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:26.973543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:27.004559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 300/596] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:27.005595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:27.051187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475aac4-10cb-4cbb-b726-a5555b170486 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:27.131529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:27.136331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:27.137385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:27.137706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:27.138145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:27.139193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:27.139633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:27.141453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:27.160564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 297/597] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:27.160564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:27.198658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377993c8-6d74-46bb-ba2c-d8deb0827887 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:27.225053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:27.273200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:27.274621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:27.275113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:27.275605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:27.277001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:27.277559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:27.280471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:27.308411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 301/598] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:27.309318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:27.314291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c8d73-e459-4255-9ed9-e8a65326a83c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:27.392647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:27.393541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:27.394026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:27.394527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:27.411584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:27.414769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:27.438713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:27.448595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 298/599] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:27.451196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:27.506849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c7dce-14c4-434c-bbfc-6f1f9383f137 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:27.581746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da255774-39d2-485f-bb98-df662b5369e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:27.582940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255774-39d2-485f-bb98-df662b5369e5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:27.583558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255774-39d2-485f-bb98-df662b5369e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:27.584134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255774-39d2-485f-bb98-df662b5369e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:27.589853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:27.607523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da255774-39d2-485f-bb98-df662b5369e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-da255774-39d2-485f-bb98-df662b5369e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:27.617960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:27.619535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:27.621089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 302/600] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:27.622426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da255774-39d2-485f-bb98-df662b5369e5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:27.678747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:27.686772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861410f2-176a-47bd-b62f-38f663130b7a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:27.764245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:27.765335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:27.765797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:27.766280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:27.778788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:27.780852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:27.800801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:27.801948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 299/601] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:27.808243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:27.821421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da255774-39d2-485f-bb98-df662b5369e5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:27.883746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134e5c-ad09-45e7-853c-a82e48305018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:27.884479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134e5c-ad09-45e7-853c-a82e48305018 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:27.884772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134e5c-ad09-45e7-853c-a82e48305018 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:27.885047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134e5c-ad09-45e7-853c-a82e48305018 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/b310f17f81e040ac80dc1b9de52026f4/roles/e45cf88b951c40d793eb810b5b33c8de` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:27.906766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134e5c-ad09-45e7-853c-a82e48305018 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=b310f17f81e040ac80dc1b9de52026f4, role_id=e45cf88b951c40d793eb810b5b33c8de)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:27.909233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134e5c-ad09-45e7-853c-a82e48305018 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:27.929886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 303/602] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:17:27 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/b310f17f81e040ac80dc1b9de52026f4/roles/e45cf88b951c40d793eb810b5b33c8de => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:17:27.930697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134e5c-ad09-45e7-853c-a82e48305018 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:28.001149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef349f1-c69f-41e5-825e-13a2b1b65086 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:28.011568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:28.076134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:28.076888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:28.077136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:28.077382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:28.078497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:28.078803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:28.082002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:28.088052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134e5c-ad09-45e7-853c-a82e48305018 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:28.132414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 300/603] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Sep 13 12:17:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:28.132414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:28.168176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:28.169818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:28.170472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:28.171074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:28.172934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:28.173386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:28.175549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:28.179990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:28.185900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 304/604] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:28.186776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:28.339507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c98d6-16c4-4ac9-aade-084630469b1b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:28.367144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349e6d3-eef0-4fa4-b394-93fe80dac649 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:28.385656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:28.417577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:28.419108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:28.419819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:28.420585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:28.422192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:28.423051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:28.426426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:28.453124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 301/605] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:28.453542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:28.454731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:28.455209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:28.455909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:28.456667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:28.499415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:28.501826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:28.545917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:28.547780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:28.562407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:28.562407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:28.562407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:28.562407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 305/606] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:28.562407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:28.601899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:28.629397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b42cb-6129-4d56-b219-50606a7a9ff1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:28.691390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:28.692476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:28.692961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:28.693439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:28.721771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:28.725894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:28.737049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd056b1-aa8b-47b2-ac9a-09308c6fa735 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:28.762331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:28.763599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:28.764763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:28.764763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:28.764763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:28.764763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 302/607] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:28.764763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:28.796912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b9b9-59cf-4815-a714-cd05b69e5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:28.798088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b9b9-59cf-4815-a714-cd05b69e5121 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:28.798605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b9b9-59cf-4815-a714-cd05b69e5121 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:28.799203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b9b9-59cf-4815-a714-cd05b69e5121 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/b7b8243a35594402943d956a93cda7b3/roles/e45cf88b951c40d793eb810b5b33c8de` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:28.830326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931b9b9-59cf-4815-a714-cd05b69e5121 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=b7b8243a35594402943d956a93cda7b3, role_id=e45cf88b951c40d793eb810b5b33c8de)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:28.832849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931b9b9-59cf-4815-a714-cd05b69e5121 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:28.868751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 306/608] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:17:28 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/b7b8243a35594402943d956a93cda7b3/roles/e45cf88b951c40d793eb810b5b33c8de => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:17:28.871823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b9b9-59cf-4815-a714-cd05b69e5121 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:28.910310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:29.030507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6b56-2f0f-4b10-b7f2-57e72b3a279f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:29.072851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:29.079171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9482f-eedd-4a52-a78e-b4246ee544e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:29.079907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9482f-eedd-4a52-a78e-b4246ee544e6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:29.080168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9482f-eedd-4a52-a78e-b4246ee544e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:29.080410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9482f-eedd-4a52-a78e-b4246ee544e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:29.081561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9482f-eedd-4a52-a78e-b4246ee544e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:29.082072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9482f-eedd-4a52-a78e-b4246ee544e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:29.083854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9482f-eedd-4a52-a78e-b4246ee544e6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:29.100572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 303/609] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:29.102411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960392-afcd-42c8-8d61-357525631968 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:29.102968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960392-afcd-42c8-8d61-357525631968 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:29.103435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960392-afcd-42c8-8d61-357525631968 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:29.105487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 304/610] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:29.106571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61960392-afcd-42c8-8d61-357525631968 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:29.146263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b9b9-59cf-4815-a714-cd05b69e5121 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:29.202920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b09cb-36b0-4f8c-836e-6eb0cf3fb4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:29.203910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b09cb-36b0-4f8c-836e-6eb0cf3fb4cd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:29.204378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b09cb-36b0-4f8c-836e-6eb0cf3fb4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:29.204878 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b09cb-36b0-4f8c-836e-6eb0cf3fb4cd None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:29.206485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b09cb-36b0-4f8c-836e-6eb0cf3fb4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:29.207004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b09cb-36b0-4f8c-836e-6eb0cf3fb4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:29.210321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b09cb-36b0-4f8c-836e-6eb0cf3fb4cd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:29.231420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 307/611] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:29.242310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c093f-12b3-4a1e-80f3-2f8938c8140b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:29.243222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c093f-12b3-4a1e-80f3-2f8938c8140b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:29.243977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c093f-12b3-4a1e-80f3-2f8938c8140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:29.276756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f46c093f-12b3-4a1e-80f3-2f8938c8140b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:29.279447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f46c093f-12b3-4a1e-80f3-2f8938c8140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:29.282822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61960392-afcd-42c8-8d61-357525631968 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:29.351810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:29.353564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:29.354413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:29.355149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:29.368665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:29.372107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:29.395006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:29.396773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:29.398503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:29.398503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:29.398503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:29.398503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:29.398503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:29.398503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:29.398503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:29.398503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:29.403378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 305/612] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:29.405468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:29.417110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:29.432557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 308/613] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:29.432557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c093f-12b3-4a1e-80f3-2f8938c8140b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:29.560946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:29.667075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e542372-6e79-4422-a204-213efc794c71 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:29.736315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:29.737651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:29.738118 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:29.738564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:29.755034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:29.756913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c093f-12b3-4a1e-80f3-2f8938c8140b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:29.757620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:29.782096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:29.783544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:29.785219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:29.789572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 306/614] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:29.795339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:29.872182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:29.872770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:29.873049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:29.873320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:29.874050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:29.874356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:29.875890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:29.909147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 309/615] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:29.934611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:30.005106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07672535-3d57-4f51-b1e3-2053648df3c0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:30.023055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:30.082097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:30.083012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:30.083416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:30.083821 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:30.085000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:30.085502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:30.088300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:30.136573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 307/616] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Sep 13 12:17:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:30.140283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:30.143529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:30.241336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407763a3-318e-4671-93a4-18bf71473294 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:30.283549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68846a49-5318-40b7-b88e-861ccc9badf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:30.284536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68846a49-5318-40b7-b88e-861ccc9badf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:30.284820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68846a49-5318-40b7-b88e-861ccc9badf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:30.285200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68846a49-5318-40b7-b88e-861ccc9badf6 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/ac7ccabe29f4464bafbdd7b5aab7d775/roles/e45cf88b951c40d793eb810b5b33c8de` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:30.314317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68846a49-5318-40b7-b88e-861ccc9badf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=ac7ccabe29f4464bafbdd7b5aab7d775, role_id=e45cf88b951c40d793eb810b5b33c8de)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:30.317427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68846a49-5318-40b7-b88e-861ccc9badf6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:30.349401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 310/617] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:17:29 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/ac7ccabe29f4464bafbdd7b5aab7d775/roles/e45cf88b951c40d793eb810b5b33c8de => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:17:30.351104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68846a49-5318-40b7-b88e-861ccc9badf6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:30.358177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94095c-6af3-40cd-90ce-547ec8a90699 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:30.494420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:30.496123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:30.497009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:30.497763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:30.538069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:30.541117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:30.581863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68846a49-5318-40b7-b88e-861ccc9badf6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:30.601873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:30.606788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:30.607987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:30.609612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:30.609612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:30.609612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:30.609612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 308/618] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:30.618639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:30.645298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:30.663380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdcc61-120e-47eb-837f-85a3967cb21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:30.665434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcc61-120e-47eb-837f-85a3967cb21d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:30.666604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcc61-120e-47eb-837f-85a3967cb21d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:30.666604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcc61-120e-47eb-837f-85a3967cb21d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:30.689827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdcc61-120e-47eb-837f-85a3967cb21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d5fdcc61-120e-47eb-837f-85a3967cb21d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:30.700206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:30.701270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:30.702084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:30.702733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 311/619] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:30.711313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdcc61-120e-47eb-837f-85a3967cb21d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:30.824377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6f88-2440-4e8b-b9c5-cb2244f9251a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:30.894962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12466-be0e-44a0-8533-e5b7ec921e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:30.896037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12466-be0e-44a0-8533-e5b7ec921e69 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:30.896559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12466-be0e-44a0-8533-e5b7ec921e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:30.897044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12466-be0e-44a0-8533-e5b7ec921e69 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:30.898301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a12466-be0e-44a0-8533-e5b7ec921e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:30.899956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a12466-be0e-44a0-8533-e5b7ec921e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:30.903115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a12466-be0e-44a0-8533-e5b7ec921e69 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:30.932105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 309/620] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:30.937914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940e68-29cf-4de7-9dde-fe611b0f0066 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:30.940920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940e68-29cf-4de7-9dde-fe611b0f0066 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:30.943251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940e68-29cf-4de7-9dde-fe611b0f0066 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:30.946512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 310/621] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:30.947974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc940e68-29cf-4de7-9dde-fe611b0f0066 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:30.958037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdcc61-120e-47eb-837f-85a3967cb21d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:31.041745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1be58-e6b7-4a9a-b3d4-86e719011d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:31.043475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1be58-e6b7-4a9a-b3d4-86e719011d32 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.044297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1be58-e6b7-4a9a-b3d4-86e719011d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.045121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1be58-e6b7-4a9a-b3d4-86e719011d32 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.046685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1be58-e6b7-4a9a-b3d4-86e719011d32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:31.047637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1be58-e6b7-4a9a-b3d4-86e719011d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:31.051966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1be58-e6b7-4a9a-b3d4-86e719011d32 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:31.071936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 312/622] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:31.074979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8f2bb-000a-4c24-80f9-899722056bb7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.075870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8f2bb-000a-4c24-80f9-899722056bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.076707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8f2bb-000a-4c24-80f9-899722056bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.114575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d6a8f2bb-000a-4c24-80f9-899722056bb7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:31.117388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d6a8f2bb-000a-4c24-80f9-899722056bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:31.132668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:31.168758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc940e68-29cf-4de7-9dde-fe611b0f0066 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:31.171609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:31.213164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:31.213873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.214150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.214422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.222733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:31.224302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:31.237807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:31.239521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:31.241225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:31.241225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:31.241225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:31.241225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:31.241225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:31.241225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:31.241225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:31.241225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:31.244148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 311/623] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:31.245346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:31.270401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 313/624] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:31.272228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8f2bb-000a-4c24-80f9-899722056bb7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:31.391541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066724f2-5267-4445-bcc2-36a3543457b8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:31.435278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee188821-f707-422d-94de-43cb98547573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:31.435943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188821-f707-422d-94de-43cb98547573 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.436224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188821-f707-422d-94de-43cb98547573 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.437014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188821-f707-422d-94de-43cb98547573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.449037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:31.456696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee188821-f707-422d-94de-43cb98547573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:31.465261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee188821-f707-422d-94de-43cb98547573 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ee188821-f707-422d-94de-43cb98547573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:31.485485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:31.486789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:31.487751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:31.487751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:31.487751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:31.490855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 312/625] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:31.497671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee188821-f707-422d-94de-43cb98547573 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:31.616977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8f2bb-000a-4c24-80f9-899722056bb7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:31.688519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee188821-f707-422d-94de-43cb98547573 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:31.689962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f70016-c286-42c5-8b1f-b092b66d4b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:31.692766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70016-c286-42c5-8b1f-b092b66d4b37 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.693087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70016-c286-42c5-8b1f-b092b66d4b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.693320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70016-c286-42c5-8b1f-b092b66d4b37 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.694063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f70016-c286-42c5-8b1f-b092b66d4b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:31.694365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f70016-c286-42c5-8b1f-b092b66d4b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:31.695856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f70016-c286-42c5-8b1f-b092b66d4b37 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:31.714660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 314/626] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:31.715696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ae7e5-e421-48c3-8566-48b0fcbe4738 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.716013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ae7e5-e421-48c3-8566-48b0fcbe4738 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.716249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ae7e5-e421-48c3-8566-48b0fcbe4738 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.722181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 315/627] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:31.723558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ae7e5-e421-48c3-8566-48b0fcbe4738 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:31.752505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d977cd4-8a90-474d-b06a-c405b0a5fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:31.753600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d977cd4-8a90-474d-b06a-c405b0a5fc41 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.753768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d977cd4-8a90-474d-b06a-c405b0a5fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.754014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d977cd4-8a90-474d-b06a-c405b0a5fc41 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.754663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d977cd4-8a90-474d-b06a-c405b0a5fc41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:31.754967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d977cd4-8a90-474d-b06a-c405b0a5fc41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:31.756542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d977cd4-8a90-474d-b06a-c405b0a5fc41 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:31.772964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 313/628] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:31.774703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414371-2df2-4a81-89e2-c893d2f14cc2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:31.774982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414371-2df2-4a81-89e2-c893d2f14cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:31.775252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414371-2df2-4a81-89e2-c893d2f14cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:31.778027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:31.796268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d7414371-2df2-4a81-89e2-c893d2f14cc2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:31.797598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d7414371-2df2-4a81-89e2-c893d2f14cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:31.855260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:31.888663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 314/629] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:31.890345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414371-2df2-4a81-89e2-c893d2f14cc2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:31.927688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ae7e5-e421-48c3-8566-48b0fcbe4738 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:32.002638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb46d9d-49ae-4772-a583-7e94e4fbdfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:32.003642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb46d9d-49ae-4772-a583-7e94e4fbdfb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:32.003642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb46d9d-49ae-4772-a583-7e94e4fbdfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:32.003901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb46d9d-49ae-4772-a583-7e94e4fbdfb3 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/149aa4c99a33498282eb285ddebe89d5/roles/e45cf88b951c40d793eb810b5b33c8de` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:32.025035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb46d9d-49ae-4772-a583-7e94e4fbdfb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=149aa4c99a33498282eb285ddebe89d5, role_id=e45cf88b951c40d793eb810b5b33c8de)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:32.026596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb46d9d-49ae-4772-a583-7e94e4fbdfb3 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:32.044678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 316/630] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:17:31 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/149aa4c99a33498282eb285ddebe89d5/roles/e45cf88b951c40d793eb810b5b33c8de => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:17:32.045793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb46d9d-49ae-4772-a583-7e94e4fbdfb3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:32.081543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414371-2df2-4a81-89e2-c893d2f14cc2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:32.148342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:32.151073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:32.151896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:32.152682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:32.164995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:32.173429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:32.177211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:32.207680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:32.209778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:32.211364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 315/631] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:17:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:32.212370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:32.239660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb46d9d-49ae-4772-a583-7e94e4fbdfb3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:32.300467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:32.314633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707245-4d1d-42fb-b64a-d3d5b9acb4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:32.317244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707245-4d1d-42fb-b64a-d3d5b9acb4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:32.318124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707245-4d1d-42fb-b64a-d3d5b9acb4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:32.318894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707245-4d1d-42fb-b64a-d3d5b9acb4a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:32.339467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8707245-4d1d-42fb-b64a-d3d5b9acb4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b8707245-4d1d-42fb-b64a-d3d5b9acb4a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:32.349691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:32.351440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:32.352985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:32.357646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 317/632] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:32.359613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707245-4d1d-42fb-b64a-d3d5b9acb4a9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:32.381213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffc22c-59b6-44b9-9385-b61e0fb6d6d1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:32.423109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365830f-61ac-45b3-bb29-28f7768c03c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:32.423840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365830f-61ac-45b3-bb29-28f7768c03c7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:32.424156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365830f-61ac-45b3-bb29-28f7768c03c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:32.424541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365830f-61ac-45b3-bb29-28f7768c03c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:32.447288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365830f-61ac-45b3-bb29-28f7768c03c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b365830f-61ac-45b3-bb29-28f7768c03c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:32.458494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:32.460630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:32.462076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 316/633] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:32.463135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365830f-61ac-45b3-bb29-28f7768c03c7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:32.598766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707245-4d1d-42fb-b64a-d3d5b9acb4a9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:32.661210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:32.669729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:32.670907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:32.671509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:32.672102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:32.673812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:32.674526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:32.677556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:32.686933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:32.692680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365830f-61ac-45b3-bb29-28f7768c03c7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:32.719369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 318/634] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:17:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:32.721266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:32.768529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:32.769221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:32.769792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:32.770366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:32.771692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:32.772298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:32.775661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:32.793231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 317/635] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:32.796170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:32.929522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff15e3-443d-4be7-bf29-aa108ae45061 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:33.001550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:33.002748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:33.003614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:33.003614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:33.004280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:33.004707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:33.006225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:33.013967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac94e6c-e136-4bd5-b177-16b17f8efc02 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:33.029525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 319/636] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:33.031133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:33.085330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f56e-6261-46f0-821b-37d072de147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:33.086729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f56e-6261-46f0-821b-37d072de147e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:33.087383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f56e-6261-46f0-821b-37d072de147e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:33.088032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f56e-6261-46f0-821b-37d072de147e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:33.157665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:33.170614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:33.234320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2f56e-6261-46f0-821b-37d072de147e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:33.237175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2f56e-6261-46f0-821b-37d072de147e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:33.278254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec65a8-bbe0-4782-b053-a767f6131bcd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:33.327678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:33.328743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:33.329142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:33.329558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:33.345400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:33.346982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:33.363713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:33.365381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:33.367327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:33.367327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:33.367327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:33.369753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 320/637] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:33.370639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:33.441539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 318/638] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:33.441539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26af22-9394-43ae-b109-0b3433fe1d2a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:33.441539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26af22-9394-43ae-b109-0b3433fe1d2a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:33.441539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26af22-9394-43ae-b109-0b3433fe1d2a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:33.441539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 319/639] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:33.441539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26af22-9394-43ae-b109-0b3433fe1d2a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:33.530252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:33.544790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f39d61-85da-4d51-8b41-7fae24227467 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:33.548241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:33.605124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26af22-9394-43ae-b109-0b3433fe1d2a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:33.605615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b51d-49a7-4b76-b72c-87311ce44a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:33.606347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b51d-49a7-4b76-b72c-87311ce44a86 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:33.606760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b51d-49a7-4b76-b72c-87311ce44a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:33.607186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b51d-49a7-4b76-b72c-87311ce44a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:33.624861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699b51d-49a7-4b76-b72c-87311ce44a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:33.626747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699b51d-49a7-4b76-b72c-87311ce44a86 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7699b51d-49a7-4b76-b72c-87311ce44a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:33.645558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:33.647397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:33.658616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:33.658616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:33.658616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:33.658616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 321/640] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:33.658616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a580d-c2f1-44a2-a34a-12d8b2f8c20b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:33.658616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a580d-c2f1-44a2-a34a-12d8b2f8c20b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:33.658616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a580d-c2f1-44a2-a34a-12d8b2f8c20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:33.680232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8f8a580d-c2f1-44a2-a34a-12d8b2f8c20b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:33.681959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8f8a580d-c2f1-44a2-a34a-12d8b2f8c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:33.690853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:33.691903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:33.692428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:33.692766 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:33.693819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:33.694344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:33.696855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:33.727669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 320/641] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:33.727669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:33.785782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 322/642] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:33.787269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a580d-c2f1-44a2-a34a-12d8b2f8c20b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:33.929875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9e7e5-b5ce-4a96-8e89-d711f3bca84e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:33.948318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:33.980155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:33.980444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a580d-c2f1-44a2-a34a-12d8b2f8c20b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:34.006465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:34.008072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:34.008840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:34.009619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:34.031839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:34.035350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:34.055794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:34.057022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:34.057489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:34.057962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:34.059067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:34.059614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:34.062273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:34.068572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:34.070296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:34.071944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:34.071944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:34.071944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:34.075501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 321/643] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:34.077441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:34.095430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 323/644] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:34.100817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:34.246326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e99a9-32d3-4061-8578-18509c61f7da None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:34.289567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:34.290620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:34.291115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:34.291592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:34.303892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60ad0b-b466-44b7-acea-897226b91915 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:34.307064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:34.315132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:34.340430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:34.342280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:17:34.345204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:34.349503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 322/645] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:34.350481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:34.361878 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:34.362903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:34.363355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:34.363798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:34.364969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:34.365500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:34.368020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:34.386967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 324/646] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:34.389321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:34.397911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:34.404990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:34.522135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fcfaf-3cef-4442-bd71-65c2bad0a31d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:34.574134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f9f9-2706-4edb-bf2d-93a991f2988d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:34.585739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:34.586407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:34.586709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:34.586963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:34.600891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:34.603516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:34.618970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:34.620048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 323/647] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:34.622391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:34.649528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21e47e-ae65-40a2-8fc3-15be7ed21a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:34.650544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21e47e-ae65-40a2-8fc3-15be7ed21a55 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:34.650986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21e47e-ae65-40a2-8fc3-15be7ed21a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:34.651455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21e47e-ae65-40a2-8fc3-15be7ed21a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:34.673285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21e47e-ae65-40a2-8fc3-15be7ed21a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4d21e47e-ae65-40a2-8fc3-15be7ed21a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:34.682154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:34.683216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:34.684040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:34.689489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 325/648] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:34.689489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21e47e-ae65-40a2-8fc3-15be7ed21a55 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:34.780430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:34.796241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b6e83-b90a-4d24-a0b3-777ae9324be2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:34.807537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:34.857151 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:34.857956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:34.858362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:34.858739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:34.859944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:34.860463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:34.863240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:34.872214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21e47e-ae65-40a2-8fc3-15be7ed21a55 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:34.899945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 324/649] 10.222.0.55 () {56 vars in 1139 bytes} [Tue Sep 13 12:17:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:34.899945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:34.940155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:34.941060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:34.941425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:34.941767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:34.951460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:34.953235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:34.967348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:34.969145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:34.970816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:34.970816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:34.970816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:34.970816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:34.970816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:34.970816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:34.970816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:34.970816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:34.974270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 326/650] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:34.975434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:35.087429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f9552-c2d4-4f13-9f4e-a78e6cd5d28f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:35.100580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88c118-8e54-4e4e-b54f-c6ea0c8728c2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:35.127958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:35.136699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:35.137717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.138218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.138674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.140042 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:35.140318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:35.140623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:35.140981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.141257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.141528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.142214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:35.142745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:35.143639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:35.143948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:35.155146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 327/651] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:35.156218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:35.175407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 325/652] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Sep 13 12:17:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:35.176507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:35.194951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:35.291199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce755a-3cfb-4d2d-93d6-7216fd329df2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:35.309519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1767ae-5232-4a4d-9e13-b6f6237ae8a8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:35.336874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ceb1c-a440-4dd8-85fe-e5fc07ec707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:35.337932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ceb1c-a440-4dd8-85fe-e5fc07ec707d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.338423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ceb1c-a440-4dd8-85fe-e5fc07ec707d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.338929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ceb1c-a440-4dd8-85fe-e5fc07ec707d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.354193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70a871-175d-4e33-abdc-e96b0dee17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:35.355785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70a871-175d-4e33-abdc-e96b0dee17d7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.355785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70a871-175d-4e33-abdc-e96b0dee17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.356187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70a871-175d-4e33-abdc-e96b0dee17d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.357533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70a871-175d-4e33-abdc-e96b0dee17d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:35.358084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70a871-175d-4e33-abdc-e96b0dee17d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:35.360885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70a871-175d-4e33-abdc-e96b0dee17d7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:35.383567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 326/653] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:35.385908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685954ee-bb73-4e38-b045-45db872a36be None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.386414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685954ee-bb73-4e38-b045-45db872a36be None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.386867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685954ee-bb73-4e38-b045-45db872a36be None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.389727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 327/654] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:35.391135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685954ee-bb73-4e38-b045-45db872a36be None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:35.428745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:35.447897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ceb1c-a440-4dd8-85fe-e5fc07ec707d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:35.449813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ceb1c-a440-4dd8-85fe-e5fc07ec707d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:35.496967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:35.535444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685954ee-bb73-4e38-b045-45db872a36be None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:35.579392 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:35.580187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.580591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.580863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.594333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:35.596924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:35.618833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:35.620809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:35.622542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:35.622542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:35.622542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:35.622542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 328/655] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:35.623008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 328/656] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:35.623521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ceb1c-a440-4dd8-85fe-e5fc07ec707d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:35.624705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:35.740688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:35.763578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ceb1c-a440-4dd8-85fe-e5fc07ec707d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:35.771343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976eab3-7a01-47a7-a0ae-d40363d71dfd None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:35.799778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:35.813485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdd0bd-8d80-4324-9c12-c4626d6307f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:35.814122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdd0bd-8d80-4324-9c12-c4626d6307f6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.814513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdd0bd-8d80-4324-9c12-c4626d6307f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.814910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdd0bd-8d80-4324-9c12-c4626d6307f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.820306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e9c5b-ced3-44b3-b447-5a8bcb42a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:35.821266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9c5b-ced3-44b3-b447-5a8bcb42a10d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.821707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9c5b-ced3-44b3-b447-5a8bcb42a10d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.822147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9c5b-ced3-44b3-b447-5a8bcb42a10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.823420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e9c5b-ced3-44b3-b447-5a8bcb42a10d None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=536e042f0d76408b9379af15526878b3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:35.823909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e9c5b-ced3-44b3-b447-5a8bcb42a10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:35.826504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e9c5b-ced3-44b3-b447-5a8bcb42a10d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:35.836794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 329/657] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:35 2022] GET /identity/v3/role_assignments?user.id=536e042f0d76408b9379af15526878b3&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:35.839163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272717f-cc5b-462f-8dd7-728407ecee63 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:35.839643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272717f-cc5b-462f-8dd7-728407ecee63 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:35.840099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272717f-cc5b-462f-8dd7-728407ecee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:35.872090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c272717f-cc5b-462f-8dd7-728407ecee63 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:35.874043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c272717f-cc5b-462f-8dd7-728407ecee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:35.923550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdd0bd-8d80-4324-9c12-c4626d6307f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:35.925554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdd0bd-8d80-4324-9c12-c4626d6307f6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:35.995728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 330/658] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:35.997043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272717f-cc5b-462f-8dd7-728407ecee63 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:36.114857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:36.132082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 329/659] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:36.133027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdd0bd-8d80-4324-9c12-c4626d6307f6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:36.151400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272717f-cc5b-462f-8dd7-728407ecee63 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:36.184795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:36.200870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:36.201529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:36.201805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:36.202077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:36.222558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:36.225385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:36.250106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:36.251230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:36.253136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:36.253136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:36.253136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:36.253136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 331/660] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:36.254504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:36.306049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdd0bd-8d80-4324-9c12-c4626d6307f6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:36.381963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:36.383082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:36.383525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:36.383987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:36.385188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:36.385713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:36.388310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:36.412646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 330/661] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:36.412646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:36.419287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b7973-136c-493e-a448-ffc6637ac325 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:36.473264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:36.482488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:36.483254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:36.483691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:36.484185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:36.503653 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:36.505671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:36.526117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:36.527956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:36.530261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:36.530261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:36.530261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:36.530261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 332/662] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:36.530261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:36.575707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:36.606064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91014a9f-2ffd-409e-a407-3c3bc3c99b99 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:36.647786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:36.648440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:36.649056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:36.649322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:36.649997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:36.650290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:36.651726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:36.671915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 331/663] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:36.672959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:36.696424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d72b-8237-4cba-9f2d-9d534790c411 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:36.757915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c0c6-69ea-4a1f-baa2-67f89a1354d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:36.758883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c0c6-69ea-4a1f-baa2-67f89a1354d1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:36.759164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c0c6-69ea-4a1f-baa2-67f89a1354d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:36.759520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c0c6-69ea-4a1f-baa2-67f89a1354d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:36.780908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5c0c6-69ea-4a1f-baa2-67f89a1354d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7ce5c0c6-69ea-4a1f-baa2-67f89a1354d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:36.792056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:36.794133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:36.795777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 333/664] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:36.798537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c0c6-69ea-4a1f-baa2-67f89a1354d1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:36.857365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b789-1310-4940-b345-6ad17f516569 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:36.859885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:36.912489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:36.913147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:36.913435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:36.913691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:36.922861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:36.925252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:36.939002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:36.940997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:17:36.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:36.945563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 332/665] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:36.946547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:36.949660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:36.950219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c0c6-69ea-4a1f-baa2-67f89a1354d1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:36.999705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.000780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.001236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.001659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.002541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:37.002980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.004974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:37.022182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 334/666] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:37.023276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:37.088558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd435-0e57-42c3-84ac-c2efc9669d30 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:37.144323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.145268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.145713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.146185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.157669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.160477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:37.177689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67290589-aff6-4f95-8a5b-e1d2b0ed1b45 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:37.180682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:37.182354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 333/667] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:37.184045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:37.193372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:37.241979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.242616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.242890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.243159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.243840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:37.244140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.246771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:37.261651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 335/668] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:37.261651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:37.297965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:37.366984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3909c2-b594-4b64-9b4d-9e75ccd6e144 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:37.391101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948409d3-c277-47da-aacb-4cdd7f5fcfe3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:37.414377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.415717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.416143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.416611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.417672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:37.417995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.419520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:37.444877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 334/669] 10.222.0.55 () {56 vars in 1137 bytes} [Tue Sep 13 12:17:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:37.446394 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:37.457753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.458801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.459255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.459696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.472289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.474438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:37.490230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:37.491236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:37.492124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:37.492124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:37.492124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:37.492124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:37.492124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:37.492124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:37.492124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:37.492124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:37.492588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 336/670] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:37.493225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:37.530344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:37.601928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22445c65-84a7-4e8c-8c62-d487b3d5230c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:37.629933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:37.634002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de68ac8-e894-4e16-b276-032aeab11559 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:37.653132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.653966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.654356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.654842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.655872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:37.656533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.658336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:37.681606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 335/671] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:37.681606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:37.684933 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.685967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.686433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.686857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.705609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.708237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:37.734583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:37.735638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:37.742146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:37.742146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:37.742146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:37.742146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 337/672] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:37.742146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:37.834078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50657851-6795-4d64-888d-9b4eac43e3c2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:37.849906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:37.878560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3a9c-59c7-4c03-be2c-d85ea808d503 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:37.879688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5a8c-7411-46fa-a31a-4c66dd4f35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.880482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5a8c-7411-46fa-a31a-4c66dd4f35cf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.880860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5a8c-7411-46fa-a31a-4c66dd4f35cf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.881233 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5a8c-7411-46fa-a31a-4c66dd4f35cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.931109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:37.931761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:37.932044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:37.932475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:37.933212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:37.933513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.935009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:37.951443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 338/673] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:37.952329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:37.957234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:37.981260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab5a8c-7411-46fa-a31a-4c66dd4f35cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:37.982775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab5a8c-7411-46fa-a31a-4c66dd4f35cf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:38.130646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 336/674] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:38.130646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5a8c-7411-46fa-a31a-4c66dd4f35cf None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:38.152791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd913d63-68d3-4ade-aacd-01d0b86a157a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:38.217040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:38.219220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:38.219708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:38.220195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:38.222334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=b310f17f81e040ac80dc1b9de52026f4) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:38.222900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:38.225576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:38.238300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 339/675] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:37 2022] GET /identity/v3/role_assignments?user.id=b310f17f81e040ac80dc1b9de52026f4&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:38.239782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:38.244239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:38.276449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:38.311175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5a8c-7411-46fa-a31a-4c66dd4f35cf None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:38.382599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:38.383724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:38.384276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:38.385760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:38.387086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:38.387700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:38.390485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:38.414645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 337/676] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:38.416820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:38.450260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a876a-b986-4f39-9f7f-aa1e563920bc None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:38.525688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506b9b-6c97-46d5-a461-462559c53b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:38.526686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506b9b-6c97-46d5-a461-462559c53b03 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:38.527146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506b9b-6c97-46d5-a461-462559c53b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:38.529850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506b9b-6c97-46d5-a461-462559c53b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:38.529850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506b9b-6c97-46d5-a461-462559c53b03 None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=b7b8243a35594402943d956a93cda7b3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:38.529850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506b9b-6c97-46d5-a461-462559c53b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:38.531487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506b9b-6c97-46d5-a461-462559c53b03 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:38.542019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 340/677] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:38 2022] GET /identity/v3/role_assignments?user.id=b7b8243a35594402943d956a93cda7b3&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:38.544923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940f71-7d9c-4929-b3d7-5ae485558711 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:38.545293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940f71-7d9c-4929-b3d7-5ae485558711 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:38.545502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940f71-7d9c-4929-b3d7-5ae485558711 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:38.547043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 341/678] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:38.548087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c940f71-7d9c-4929-b3d7-5ae485558711 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:38.648206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bca33-71a1-43a7-957d-f65a571610e3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:38.716044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:38.741275 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfca54-8141-49a2-be16-156eb32a51bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:38.742512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfca54-8141-49a2-be16-156eb32a51bb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:38.743084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfca54-8141-49a2-be16-156eb32a51bb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:38.743686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfca54-8141-49a2-be16-156eb32a51bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:38.764778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:38.772647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfca54-8141-49a2-be16-156eb32a51bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:38.776633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfca54-8141-49a2-be16-156eb32a51bb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:38.804068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c940f71-7d9c-4929-b3d7-5ae485558711 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-21dfca54-8141-49a2-be16-156eb32a51bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:38.804537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:38.806252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:38.807897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:38.807897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:38.807897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:38.807897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 338/679] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:38.815431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca1ee-b2f4-4595-a13f-aa2b1d8a3ede None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:38.816016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca1ee-b2f4-4595-a13f-aa2b1d8a3ede None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:38.816516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca1ee-b2f4-4595-a13f-aa2b1d8a3ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:38.850406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5c8ca1ee-b2f4-4595-a13f-aa2b1d8a3ede None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:38.851971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5c8ca1ee-b2f4-4595-a13f-aa2b1d8a3ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:38.875589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:38.877102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:38.878191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:38.878878 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:38.893867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:38.897050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:38.921346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:38.923271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:38.925994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:38.929865 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 342/680] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:38.936474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:38.962223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 339/681] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:38.969302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca1ee-b2f4-4595-a13f-aa2b1d8a3ede None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:39.243677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920b9e-846c-4946-aadc-2c54d7bd1d94 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:39.261898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca1ee-b2f4-4595-a13f-aa2b1d8a3ede None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:39.281428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:39.294492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:39.295129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:39.295476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:39.295757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:39.296745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:39.297054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:39.300074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:39.316690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 343/682] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:39.316968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:39.317667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:39.339001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:39.339640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:39.339916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:39.340229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:39.341026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:39.341331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:39.342904 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:39.368425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 340/683] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Sep 13 12:17:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:39.368425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:39.468268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a8b84-f271-4844-99f6-6bacac067ced None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:39.489844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54f4e-2827-407c-b4d1-ef8817a796c5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:39.517064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f99f-acdf-41c9-b699-c406a3ddd1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:39.518525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f99f-acdf-41c9-b699-c406a3ddd1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:39.518826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f99f-acdf-41c9-b699-c406a3ddd1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:39.519112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f99f-acdf-41c9-b699-c406a3ddd1e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:39.530408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:39.531080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:39.531337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:39.531605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:39.531824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9f99f-acdf-41c9-b699-c406a3ddd1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0df9f99f-acdf-41c9-b699-c406a3ddd1e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:39.537997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:39.540107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:39.542456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 344/684] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:39.544047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:39.544207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f99f-acdf-41c9-b699-c406a3ddd1e6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:39.544369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:39.554482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:39.557460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:39.560290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:39.560290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:39.560290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:39.560290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:39.560290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:39.560290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:39.560290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:39.560290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:39.561733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 341/685] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:39.561946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:39.603555 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:39.637157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:39.670481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f99f-acdf-41c9-b699-c406a3ddd1e6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:39.688175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ee735-8261-4970-ab0d-5983bc67d0e0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:39.715107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530e86-4c22-435d-b734-d81629990509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:39.715955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530e86-4c22-435d-b734-d81629990509 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:39.716303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530e86-4c22-435d-b734-d81629990509 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:39.716726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530e86-4c22-435d-b734-d81629990509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:39.732914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:39.733905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:39.734355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:39.734898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:39.735848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:39.736744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:39.738590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:39.749127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 342/686] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:39.750358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:39.804490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530e86-4c22-435d-b734-d81629990509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:39.805913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530e86-4c22-435d-b734-d81629990509 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:39.865231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:39.876143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77f949-ef5d-450a-88de-4b1868be69b8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:39.880931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:39.920547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:39.921573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:39.922076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:39.922538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:39.923614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:39.924143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:39.926061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:39.948778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 343/687] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:39.950262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:39.980739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 345/688] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:39.982321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530e86-4c22-435d-b734-d81629990509 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:40.069906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72a7fe-7b8f-4559-b425-d451263f19bc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:40.110781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:40.111974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:40.112665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:40.113134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:40.125781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:40.127976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:40.145994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:40.146980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:40.147840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:40.147840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:40.147840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:40.150481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 344/689] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:40.151725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:40.171296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:40.179431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530e86-4c22-435d-b734-d81629990509 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:40.255418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:40.257633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:40.258465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:40.259223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:40.260900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=ac7ccabe29f4464bafbdd7b5aab7d775) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:40.261830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:40.265170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:40.272427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6c201-5f56-4c15-9c7f-15ecd4ee6b34 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:40.280082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 346/690] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:39 2022] GET /identity/v3/role_assignments?user.id=ac7ccabe29f4464bafbdd7b5aab7d775&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:40.282000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:40.317129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:40.352073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:40.352610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:40.352892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:40.353156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:40.379998 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:40.381538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:40.408144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:40.410266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:40.412520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:40.412520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:40.412520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:40.416944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 345/691] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:40.438495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:40.531870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370a503-f4f5-46c0-b229-118e1fd3de37 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:40.591308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:40.608750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:40.610315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:40.611831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:40.612683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:40.614105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:40.614928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:40.617782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:40.642929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 347/692] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:40.650202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:40.659194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47062387-298a-4e13-a873-1aafe30675f0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:40.735095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:40.737279 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:40.738073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:40.739368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:40.740825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:40.741952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:40.745023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:40.771895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 346/693] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:40.780820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:40.808206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:40.872515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ed521-d3f9-43d0-ad56-f8b621b4d7e5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:40.943691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593ab32-ae39-41a6-88a0-c4ac658232d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:40.944757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ab32-ae39-41a6-88a0-c4ac658232d8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:40.945195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ab32-ae39-41a6-88a0-c4ac658232d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:40.945628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ab32-ae39-41a6-88a0-c4ac658232d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:40.958367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593ab32-ae39-41a6-88a0-c4ac658232d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:40.959952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593ab32-ae39-41a6-88a0-c4ac658232d8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2593ab32-ae39-41a6-88a0-c4ac658232d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:40.978946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:40.980002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 348/694] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:17:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb2a0-b54e-4fee-8431-4d174f53682c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:40.981038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb2a0-b54e-4fee-8431-4d174f53682c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:40.981782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb2a0-b54e-4fee-8431-4d174f53682c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:40.988319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 349/695] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:40.988319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cb2a0-b54e-4fee-8431-4d174f53682c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:40.990881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177445a2-b2a4-450d-a091-5b45f9783780 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:41.060439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:41.081200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac78647-a1fc-4bde-b902-6dec62185357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:41.082243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78647-a1fc-4bde-b902-6dec62185357 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:41.082712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78647-a1fc-4bde-b902-6dec62185357 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:41.083581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78647-a1fc-4bde-b902-6dec62185357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:41.102304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac78647-a1fc-4bde-b902-6dec62185357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:41.105997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac78647-a1fc-4bde-b902-6dec62185357 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-0ac78647-a1fc-4bde-b902-6dec62185357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:41.140046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:41.141657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:41.143188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:41.143188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:41.143188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:41.143188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:41.143188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:41.143188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:41.143188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:41.143188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:41.147942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 347/696] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:41.150867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e15a8-14ef-4645-9170-c97e0900c711 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:41.153158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e15a8-14ef-4645-9170-c97e0900c711 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:41.153797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e15a8-14ef-4645-9170-c97e0900c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:41.156059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cb2a0-b54e-4fee-8431-4d174f53682c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:41.185927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fe3e15a8-14ef-4645-9170-c97e0900c711 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:41.187637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fe3e15a8-14ef-4645-9170-c97e0900c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:41.210581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:41.225714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:41.226726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:41.227212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:41.227698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:41.229975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:41.230514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:41.234524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:41.284148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 350/697] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:17:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:41.286133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:41.300701 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 348/698] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:41.302122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e15a8-14ef-4645-9170-c97e0900c711 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:41.520841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257085ec-bf25-433b-8f73-f1deb065758d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:41.547466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e15a8-14ef-4645-9170-c97e0900c711 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:41.591645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:41.605439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:41.606515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:41.607002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:41.607520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:41.609099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:41.609671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:41.612597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:41.637923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 351/699] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:41.650066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:41.655769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96259068-e5da-4538-bbd9-97cff3e48719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:41.656904 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259068-e5da-4538-bbd9-97cff3e48719 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:41.657402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259068-e5da-4538-bbd9-97cff3e48719 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:41.657983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259068-e5da-4538-bbd9-97cff3e48719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:41.737420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:41.804060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96259068-e5da-4538-bbd9-97cff3e48719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:41.805524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96259068-e5da-4538-bbd9-97cff3e48719 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:41.810403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f7fe-48f1-4ebd-ada2-3e0faa5667e9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:41.865882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcad9e7-1d18-4605-8904-60398fedbe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:41.866938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad9e7-1d18-4605-8904-60398fedbe97 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:41.867533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad9e7-1d18-4605-8904-60398fedbe97 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:41.867996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad9e7-1d18-4605-8904-60398fedbe97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:41.869413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcad9e7-1d18-4605-8904-60398fedbe97 None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=149aa4c99a33498282eb285ddebe89d5) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:41.869926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcad9e7-1d18-4605-8904-60398fedbe97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:41.872481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcad9e7-1d18-4605-8904-60398fedbe97 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:41.883049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 352/700] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:41 2022] GET /identity/v3/role_assignments?user.id=149aa4c99a33498282eb285ddebe89d5&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:41.884995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ab0c2-dd1a-4e78-81ea-6113dca37531 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:41.885468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ab0c2-dd1a-4e78-81ea-6113dca37531 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:41.885931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ab0c2-dd1a-4e78-81ea-6113dca37531 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:41.892512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 353/701] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:41.892512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ab0c2-dd1a-4e78-81ea-6113dca37531 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:42.005276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 349/702] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:17:42.006689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2d90-515f-4b13-957f-2774d6282c52 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:42.007106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2d90-515f-4b13-957f-2774d6282c52 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:42.007554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2d90-515f-4b13-957f-2774d6282c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:42.034108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b90d2d90-515f-4b13-957f-2774d6282c52 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:42.035591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b90d2d90-515f-4b13-957f-2774d6282c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:42.047140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ab0c2-dd1a-4e78-81ea-6113dca37531 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:42.052304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:42.068975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:42.099099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:42.100191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:42.100732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:42.101268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] PATH_INFO: `/v3/services/network` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:42.101888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:42.103473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:42.117184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:42.118334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:42.119194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 354/703] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:41 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:42.119999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:42.169657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 350/704] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:42.170351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2d90-515f-4b13-957f-2774d6282c52 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:42.298782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f121a0f-e0eb-4a9f-8c3d-9ae87552fadf None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:42.312944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2d90-515f-4b13-957f-2774d6282c52 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:42.356880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:42.357438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:42.357719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:42.357982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:42.373365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:42.374910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:42.375550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:42.377227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:42.378273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:42.379475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:42.381563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] RBAC: Adding query filter params (name=network) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:42.382322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:42.384192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:42.394980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 351/705] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:17:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:42.403404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:42.413091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:42.414895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:42.416695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:42.416695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:42.416695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:42.416695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 355/706] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:42.422451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:42.432936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:42.493374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:42.617676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95e16d-a5f6-4312-bb4d-0da7e8ead819 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:42.632098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df3665-1e76-4ef9-ba37-e0989554b9cb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:42.669739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:42.671048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:42.671534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:42.671966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:42.672903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:42.673372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:42.676118 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:42.684587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:42.685680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:42.686215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:42.686626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:42.687448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:42.687902 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:42.689691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 352/707] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:17:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:42.689931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:42.691641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:42.707184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 356/708] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:42.721715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:42.839247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:42.870999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2095-f5a7-4062-b594-3c9a594ee8c7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:42.921362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:42.922622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:42.922925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:42.923205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:42.924866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:42.927037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:42.947824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:42.948914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:42.949728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:42.950453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:42.954523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 353/709] 10.222.0.55 () {56 vars in 1129 bytes} [Tue Sep 13 12:17:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:42.956828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:42.984590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae574ed-b265-431f-8436-b01d1ea7d418 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:43.039013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:43.042264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:43.042544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:43.042824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:43.052637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:43.054294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:43.068480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:43.069429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:43.070305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 357/710] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:43.076334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:43.143841 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97187ac-1885-4284-a5a5-e383d4a8c3a0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:43.217704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:43.218783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:43.219269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:43.219743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:43.221784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:43.222332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:43.225106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:43.237590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 354/711] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Sep 13 12:17:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:43.245086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:43.249853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:43.308026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d958-3995-447c-8f65-72ba48aceb08 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:43.378723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:43.379791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:43.380267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:43.380762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:43.381674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:43.389225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:43.391079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:43.412233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 358/712] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:43.418205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:43.440620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:43.463929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fbb32-9952-4e79-b250-cfdb572ad87e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:43.564089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c575-3313-4fe7-8403-a36e08ea1611 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:43.573737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b5c47-1103-4dc7-969f-448567e7e23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:43.575240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5c47-1103-4dc7-969f-448567e7e23e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:43.575240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5c47-1103-4dc7-969f-448567e7e23e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:43.575810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5c47-1103-4dc7-969f-448567e7e23e None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:43.577039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b5c47-1103-4dc7-969f-448567e7e23e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:43.577580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b5c47-1103-4dc7-969f-448567e7e23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:43.581334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b5c47-1103-4dc7-969f-448567e7e23e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:43.605174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 355/713] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Sep 13 12:17:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:43.619547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011b8a0-f073-49f7-aa42-eefc8deb4139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:43.620736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011b8a0-f073-49f7-aa42-eefc8deb4139 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:43.621244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011b8a0-f073-49f7-aa42-eefc8deb4139 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:43.621725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011b8a0-f073-49f7-aa42-eefc8deb4139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:43.622683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011b8a0-f073-49f7-aa42-eefc8deb4139 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=536e042f0d76408b9379af15526878b3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:43.623211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011b8a0-f073-49f7-aa42-eefc8deb4139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:43.624983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011b8a0-f073-49f7-aa42-eefc8deb4139 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:43.632809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 359/714] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:43 2022] GET /identity/v3/role_assignments?user.id=536e042f0d76408b9379af15526878b3&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:43.724921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cfa4d-785e-457e-8d70-a9ccb67484eb None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:43.725459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cfa4d-785e-457e-8d70-a9ccb67484eb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:43.725776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cfa4d-785e-457e-8d70-a9ccb67484eb None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:43.729210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 356/715] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:43.734930 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959124-a038-41c4-8b8d-6228fe66d6a4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:43.735581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959124-a038-41c4-8b8d-6228fe66d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:43.736230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959124-a038-41c4-8b8d-6228fe66d6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:43.762078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d3959124-a038-41c4-8b8d-6228fe66d6a4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:43.763965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d3959124-a038-41c4-8b8d-6228fe66d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:43.871025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 360/716] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:44.169415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cfa4d-785e-457e-8d70-a9ccb67484eb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:44.276894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:44.333318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cfa4d-785e-457e-8d70-a9ccb67484eb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:44.389251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:44.389905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:44.390180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:44.390444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:44.410332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:44.411842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:44.434469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:44.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:44.436313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:44.436313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:44.436313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:44.436313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 357/717] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:44.443317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959124-a038-41c4-8b8d-6228fe66d6a4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:44.445981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:44.610555 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959124-a038-41c4-8b8d-6228fe66d6a4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:44.651313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405279aa-0394-4501-8555-3bb356cf7f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:44.652414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405279aa-0394-4501-8555-3bb356cf7f97 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:44.652957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405279aa-0394-4501-8555-3bb356cf7f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:44.653418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405279aa-0394-4501-8555-3bb356cf7f97 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:44.654287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405279aa-0394-4501-8555-3bb356cf7f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:44.654790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405279aa-0394-4501-8555-3bb356cf7f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:44.656499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405279aa-0394-4501-8555-3bb356cf7f97 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:44.671253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 361/718] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:44.679447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:44.951249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d9685-b364-4c28-85cc-77a5680b6525 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:44.994530 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:45.034429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0945de2-8462-4931-9247-f8f2f5822e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:45.035452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0945de2-8462-4931-9247-f8f2f5822e2c None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:45.035909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0945de2-8462-4931-9247-f8f2f5822e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:45.036360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0945de2-8462-4931-9247-f8f2f5822e2c None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:45.037565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0945de2-8462-4931-9247-f8f2f5822e2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:45.040446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0945de2-8462-4931-9247-f8f2f5822e2c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:45.088522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 358/719] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:17:44 2022] POST /identity/v3/users => generated 254 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:17:45.655716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9ff2c-f11f-4fe3-9f17-8513b3904237 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:45.657164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9ff2c-f11f-4fe3-9f17-8513b3904237 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:45.658018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9ff2c-f11f-4fe3-9f17-8513b3904237 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:45.661299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 362/720] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:45.670791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b213-c79e-4dc4-98aa-db76d8d9a5e7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:45.671834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b213-c79e-4dc4-98aa-db76d8d9a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:45.672579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b213-c79e-4dc4-98aa-db76d8d9a5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:45.705866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a500b213-c79e-4dc4-98aa-db76d8d9a5e7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:45.707133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a500b213-c79e-4dc4-98aa-db76d8d9a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:45.806258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 359/721] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:17:46.048609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543b4e-7b55-47a8-a6e2-d5bb2ca399d3 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:46.049118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543b4e-7b55-47a8-a6e2-d5bb2ca399d3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:46.049795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543b4e-7b55-47a8-a6e2-d5bb2ca399d3 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:46.052798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 363/722] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:46.070096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad195-a40b-4b39-b53a-45d379be3317 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:46.071596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad195-a40b-4b39-b53a-45d379be3317 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:46.072343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad195-a40b-4b39-b53a-45d379be3317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:46.117393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-20cad195-a40b-4b39-b53a-45d379be3317 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:46.118646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-20cad195-a40b-4b39-b53a-45d379be3317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:46.234010 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 360/723] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:46.375902 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543b4e-7b55-47a8-a6e2-d5bb2ca399d3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:46.538972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:46.652548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543b4e-7b55-47a8-a6e2-d5bb2ca399d3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:46.735555 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a42d6-b1d5-4e50-8c65-c108e5fe96b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:46.736923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a42d6-b1d5-4e50-8c65-c108e5fe96b4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:46.737484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a42d6-b1d5-4e50-8c65-c108e5fe96b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:46.737981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a42d6-b1d5-4e50-8c65-c108e5fe96b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:46.756696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a42d6-b1d5-4e50-8c65-c108e5fe96b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8d9a42d6-b1d5-4e50-8c65-c108e5fe96b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:46.767628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:46.768797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:46.769654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:46.770286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 364/724] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:46.781587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad195-a40b-4b39-b53a-45d379be3317 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:46.826663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a42d6-b1d5-4e50-8c65-c108e5fe96b4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:46.840795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:46.981973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad195-a40b-4b39-b53a-45d379be3317 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:47.077034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:47.078111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.078606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.079090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.080550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:47.081110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:47.083822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:47.087484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a42d6-b1d5-4e50-8c65-c108e5fe96b4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:47.108576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 361/725] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:47.115360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:47.138795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:47.179897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5136-4a52-40a4-a2e8-ab51b27eadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:47.180609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5136-4a52-40a4-a2e8-ab51b27eadb8 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.181060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5136-4a52-40a4-a2e8-ab51b27eadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.181517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5136-4a52-40a4-a2e8-ab51b27eadb8 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.182371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5136-4a52-40a4-a2e8-ab51b27eadb8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:47.183975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5136-4a52-40a4-a2e8-ab51b27eadb8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:47.227749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 365/726] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:17:46 2022] POST /identity/v3/services => generated 240 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:17:47.283640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d88d1-e98e-4f15-9644-3abe35b97779 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.284347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d88d1-e98e-4f15-9644-3abe35b97779 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.284872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d88d1-e98e-4f15-9644-3abe35b97779 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.291210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 366/727] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:17:47.293749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aa49b-1329-4c12-ab01-02cee694226b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.294635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aa49b-1329-4c12-ab01-02cee694226b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.295132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aa49b-1329-4c12-ab01-02cee694226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.318399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c28aa49b-1329-4c12-ab01-02cee694226b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:47.320360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c28aa49b-1329-4c12-ab01-02cee694226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:47.347482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:47.358787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201ecf-cde0-4cdf-99a5-f399c8011000 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:47.415314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814ba4a-a97e-488c-99d7-4a68e476785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:47.416494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ba4a-a97e-488c-99d7-4a68e476785f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.417137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ba4a-a97e-488c-99d7-4a68e476785f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.417630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ba4a-a97e-488c-99d7-4a68e476785f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.435438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814ba4a-a97e-488c-99d7-4a68e476785f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:47.437073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814ba4a-a97e-488c-99d7-4a68e476785f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-2814ba4a-a97e-488c-99d7-4a68e476785f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:47.455205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:47.456209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:47.457196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:47.457196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:47.457196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:47.463199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 362/728] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:47.463395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24843b3-7223-4140-9b99-d3a69358376a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.463634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24843b3-7223-4140-9b99-d3a69358376a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.463802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24843b3-7223-4140-9b99-d3a69358376a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.465877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 363/729] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:47.466893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24843b3-7223-4140-9b99-d3a69358376a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:47.469632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 367/730] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:47 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:47.472119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3396f7-9b03-425d-a2d3-a40e944c8601 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.472823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3396f7-9b03-425d-a2d3-a40e944c8601 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.473098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3396f7-9b03-425d-a2d3-a40e944c8601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.494575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6a3396f7-9b03-425d-a2d3-a40e944c8601 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:47.495768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6a3396f7-9b03-425d-a2d3-a40e944c8601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:47.588774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 368/731] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:47 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:17:47.606764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24843b3-7223-4140-9b99-d3a69358376a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:47.652875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:47.653515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.653787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.654054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.654770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:47.655069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:47.656609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:47.674507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 364/732] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:47.680270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3396f7-9b03-425d-a2d3-a40e944c8601 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:47.753163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:47.774251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:47.778923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:47.835586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3396f7-9b03-425d-a2d3-a40e944c8601 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:47.877755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:47.878733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.879170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.879596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.888291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:47.890224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:47.904573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:47.905589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:47.906523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:47.909006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 369/733] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:47.918895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:47.939955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794152-660c-480c-a083-02ac60295c88 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:47.988438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61fea2-6a1b-46f1-9a5d-c244f39159be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:47.990691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61fea2-6a1b-46f1-9a5d-c244f39159be None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:47.991378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61fea2-6a1b-46f1-9a5d-c244f39159be None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:47.992043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61fea2-6a1b-46f1-9a5d-c244f39159be None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:47.994961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61fea2-6a1b-46f1-9a5d-c244f39159be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:47.997745 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61fea2-6a1b-46f1-9a5d-c244f39159be None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:48.026280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 365/734] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:17:47 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:17:48.027862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61fea2-6a1b-46f1-9a5d-c244f39159be None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:48.108347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:48.129318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94c1d-b9ff-4847-b14a-c5aed40b0cf9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:48.132438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:48.169506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61fea2-6a1b-46f1-9a5d-c244f39159be None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:48.199401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:48.200763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:48.201009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:48.201609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:48.202911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:48.203297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:48.205907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:48.215565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ad64-cb89-40b7-9550-d4193055ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:48.216723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ad64-cb89-40b7-9550-d4193055ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:48.217225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ad64-cb89-40b7-9550-d4193055ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:48.217704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ad64-cb89-40b7-9550-d4193055ecb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:48.231306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6ad64-cb89-40b7-9550-d4193055ecb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-aff6ad64-cb89-40b7-9550-d4193055ecb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:48.237671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:48.238677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:48.239523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:48.242434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 366/735] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:48.246890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 370/736] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Sep 13 12:17:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:48.249621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ad64-cb89-40b7-9550-d4193055ecb0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:48.258442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:48.369050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ad64-cb89-40b7-9550-d4193055ecb0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:48.404878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:48.414461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:48.416186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:48.416521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:48.416795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:48.417479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:48.417783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:48.419241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:48.435107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 367/737] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:48.441996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:48.511002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728c6a-a88e-4302-a4f5-ead2bf040660 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:48.567768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d50c9-7137-4045-87e4-04adde3abad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:48.567768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d50c9-7137-4045-87e4-04adde3abad6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:48.567768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d50c9-7137-4045-87e4-04adde3abad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:48.567768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d50c9-7137-4045-87e4-04adde3abad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:48.585213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039e9d8-e42b-4692-b996-9bf80f2946a1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:48.615965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:48.641213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:48.642606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:48.643039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:48.643416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:48.659879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:48.664420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:48.682136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:48.683182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:48.684054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:48.684054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:48.684054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:48.684054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 368/738] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:48.690070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:48.713039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d50c9-7137-4045-87e4-04adde3abad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:48.714569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d50c9-7137-4045-87e4-04adde3abad6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:48.740922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:48.827164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e44625-03c5-4ccc-8c2a-f13d36f30f6d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:48.875439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:48.876092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:48.876488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:48.876793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:48.877872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:48.878186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:48.879668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:48.897174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 369/739] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:48.905914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:48.968291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 371/740] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:17:48.975241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d50c9-7137-4045-87e4-04adde3abad6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:49.045620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:49.091260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d50c9-7137-4045-87e4-04adde3abad6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:49.133395 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0eb72-5fc6-45a8-bd64-668629e8576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:49.134069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0eb72-5fc6-45a8-bd64-668629e8576c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:49.134349 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0eb72-5fc6-45a8-bd64-668629e8576c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:49.134629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0eb72-5fc6-45a8-bd64-668629e8576c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:49.147400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0eb72-5fc6-45a8-bd64-668629e8576c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:49.149197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0eb72-5fc6-45a8-bd64-668629e8576c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d3b0eb72-5fc6-45a8-bd64-668629e8576c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:49.166583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:49.168357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:49.170465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:49.170465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:49.170465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:49.170465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 372/741] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:49.170465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e45946-14ad-4c4d-9f7a-b6f7d259aec3 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:49.170465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e45946-14ad-4c4d-9f7a-b6f7d259aec3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:49.170465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e45946-14ad-4c4d-9f7a-b6f7d259aec3 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:49.178620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 373/742] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:49.178620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e45946-14ad-4c4d-9f7a-b6f7d259aec3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:49.184097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:49.200593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa198d-bfa1-4411-9378-a63fad2fe65d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:49.270385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0f8a1-a48c-4a12-aac3-0da12a084881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:49.272001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f8a1-a48c-4a12-aac3-0da12a084881 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:49.272822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f8a1-a48c-4a12-aac3-0da12a084881 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:49.273958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0f8a1-a48c-4a12-aac3-0da12a084881 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:49.289075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0f8a1-a48c-4a12-aac3-0da12a084881 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:49.292549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0f8a1-a48c-4a12-aac3-0da12a084881 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:49.306840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e45946-14ad-4c4d-9f7a-b6f7d259aec3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ebd0f8a1-a48c-4a12-aac3-0da12a084881 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:49.318779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:49.320678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:49.322547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:49.326035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:49.328711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 370/743] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:17:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:49.331588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b572-1fb7-4dab-ba3d-d6ea41a09ea6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:49.332318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b572-1fb7-4dab-ba3d-d6ea41a09ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:49.332986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b572-1fb7-4dab-ba3d-d6ea41a09ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:49.352171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:49.352888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:49.353171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:49.353448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:49.354129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:49.354435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:49.355877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:49.369511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fba9b572-1fb7-4dab-ba3d-d6ea41a09ea6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:49.370719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 374/744] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:49.371621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:49.371820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fba9b572-1fb7-4dab-ba3d-d6ea41a09ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:49.498066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e67212-e3c7-461d-b114-712e5f3f8a69 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:49.498612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 371/745] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:17:49.499521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b572-1fb7-4dab-ba3d-d6ea41a09ea6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:49.583587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:49.584301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:49.584668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:49.585135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:49.588228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:49.588634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:49.590119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:49.622483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 375/746] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:17:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:49.630759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:49.671628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:49.693728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:49.727031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b572-1fb7-4dab-ba3d-d6ea41a09ea6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:49.768618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23822da-4d2d-4fac-82b6-2fc21c5dc746 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:49.785657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:49.786872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:49.787352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:49.787868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:49.796028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:49.797990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:49.811583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:49.812585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:49.813542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:49.813542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:49.813542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:49.813542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:49.813542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:49.813542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:49.813542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:49.813542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:49.816586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 372/747] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:49.823658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:49.848309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:49.849013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:49.849296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:49.849572 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:49.873354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:49.876153 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:49.900470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:49.901537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:49.902543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:49.902543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:49.902543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:49.904937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 376/748] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:49.906323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:49.965775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149eb8-a57c-462e-886c-41ebf56f4692 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.005025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.005669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.005945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.006218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.006943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:50.007245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:50.008762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:50.009550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:50.028630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 373/749] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:50.028630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:50.029543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:50.040916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5fc7b-2e5f-4e93-9dd7-07afb7d5611c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.083700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b61d4-813e-4edf-b9d8-5e5ebd84e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.084786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b61d4-813e-4edf-b9d8-5e5ebd84e443 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.085309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b61d4-813e-4edf-b9d8-5e5ebd84e443 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.085783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b61d4-813e-4edf-b9d8-5e5ebd84e443 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.099691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b61d4-813e-4edf-b9d8-5e5ebd84e443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e94b61d4-813e-4edf-b9d8-5e5ebd84e443 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:50.106265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:50.107270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:50.108120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:50.111029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 377/750] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:50.112583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b61d4-813e-4edf-b9d8-5e5ebd84e443 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:50.148164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bdd85-1a24-4fae-a989-9a8c0b7f064e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.188551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.189568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.189851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.190126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.190852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:50.191102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:50.192591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:50.210555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 374/751] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:50.211571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:50.249424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b61d4-813e-4edf-b9d8-5e5ebd84e443 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.281330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:50.295038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.296296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.296823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.297323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.298367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=149aa4c99a33498282eb285ddebe89d5) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:50.298953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:50.300799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:50.316949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 378/752] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:50 2022] GET /identity/v3/role_assignments?user.id=149aa4c99a33498282eb285ddebe89d5&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:50.318300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:50.326328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0cb7-2fd7-421b-855e-93cf4b51f7c0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.332944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:50.375468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.376141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.376509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.376792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.377554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:50.377959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:50.379557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:50.397781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 375/753] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:50.409533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:50.507095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4ad15-38d3-4a29-b923-c246f86c96df None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.552461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348752a-564d-445d-8c46-b876488fe3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.553556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348752a-564d-445d-8c46-b876488fe3de None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.554215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348752a-564d-445d-8c46-b876488fe3de None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.554719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348752a-564d-445d-8c46-b876488fe3de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.555938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c1b3-5384-4761-a0db-34a0327d027a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.563573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348752a-564d-445d-8c46-b876488fe3de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:50.565743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348752a-564d-445d-8c46-b876488fe3de None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4348752a-564d-445d-8c46-b876488fe3de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:50.581495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:50.582479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:50.583347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:50.583347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:50.583347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:50.583347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:50.583347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:50.583347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:50.583347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:50.583347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:50.586097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 379/754] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:50.587963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf460a-aee8-4be3-b13c-b8069eaaae83 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.588540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf460a-aee8-4be3-b13c-b8069eaaae83 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.589047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf460a-aee8-4be3-b13c-b8069eaaae83 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.591097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 380/755] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:50.592425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf460a-aee8-4be3-b13c-b8069eaaae83 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:50.599313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:50.611737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb3625-5f62-4b25-b83b-7deb9fa3e4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.612783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb3625-5f62-4b25-b83b-7deb9fa3e4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.613067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb3625-5f62-4b25-b83b-7deb9fa3e4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.613342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb3625-5f62-4b25-b83b-7deb9fa3e4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.632407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb3625-5f62-4b25-b83b-7deb9fa3e4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:50.634343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb3625-5f62-4b25-b83b-7deb9fa3e4c9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a2bb3625-5f62-4b25-b83b-7deb9fa3e4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:50.657698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:50.658694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:50.659660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:50.659660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:50.659660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:50.659827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 376/756] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:50.661334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102154-0e28-4d4a-9765-8a7cf5906f5f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.661633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102154-0e28-4d4a-9765-8a7cf5906f5f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.661898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102154-0e28-4d4a-9765-8a7cf5906f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.686013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-41102154-0e28-4d4a-9765-8a7cf5906f5f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:50.687578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-41102154-0e28-4d4a-9765-8a7cf5906f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:50.708849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:50.752828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf460a-aee8-4be3-b13c-b8069eaaae83 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.793490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.794463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.794923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.795373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.796261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:50.796769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:50.798537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:50.812974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 381/757] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:50.814211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:50.827343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 377/758] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:17:50.834182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102154-0e28-4d4a-9765-8a7cf5906f5f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:50.928893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8dde-3083-4da2-bf60-3325949e2fd5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:50.965792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:50.969913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:50.970876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:50.971334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:50.971755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:50.972631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:50.973286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:50.975085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:50.989183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 382/759] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:50.995207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:51.100365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102154-0e28-4d4a-9765-8a7cf5906f5f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:51.120815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:51.134781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6c59-acf5-46af-832c-bab5747ce210 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:51.175139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:51.175395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14fed1-08fa-45c6-b10e-df8608eb99c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:51.176343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:51.176550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14fed1-08fa-45c6-b10e-df8608eb99c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:51.177026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14fed1-08fa-45c6-b10e-df8608eb99c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:51.177151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:51.177500 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14fed1-08fa-45c6-b10e-df8608eb99c2 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/536e042f0d76408b9379af15526878b3/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:51.177843 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:51.181286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14fed1-08fa-45c6-b10e-df8608eb99c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=536e042f0d76408b9379af15526878b3, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:51.184241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14fed1-08fa-45c6-b10e-df8608eb99c2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:51.188362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:51.190465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:51.204448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:51.205491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:17:51.206409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:51.209237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 383/760] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:17:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:51.215680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:51.232670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 378/761] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:17:50 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/536e042f0d76408b9379af15526878b3/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:17:51.274554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:51.312654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14fed1-08fa-45c6-b10e-df8608eb99c2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:51.343941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d2ef3-5da1-459d-8967-c33dab7e784d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:51.386562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:51.387752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:51.388229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:51.388716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:51.389713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:51.390281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:51.392104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:51.414547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 384/762] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Sep 13 12:17:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:51.420996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:51.536232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14fed1-08fa-45c6-b10e-df8608eb99c2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:51.574511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:51.574960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:51.575241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:51.575512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] PATH_INFO: `/v3/services/network` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:51.576134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:51.577723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:51.588057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:51.589193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:51.590045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 379/763] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:51 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:51.596143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:51.619676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980b56-b1bd-4654-8094-06eac9dd554e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:51.636906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:51.645213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:51.714386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfc842-34a2-4d29-a089-62dfd688881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:51.715045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc842-34a2-4d29-a089-62dfd688881e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:51.715333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc842-34a2-4d29-a089-62dfd688881e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:51.716072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc842-34a2-4d29-a089-62dfd688881e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:51.746538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade53d-5a50-4d2f-a613-6cac388821af None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:51.809349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50938c8-5df6-4125-bd94-94d80fae2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:51.810251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50938c8-5df6-4125-bd94-94d80fae2506 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:51.810659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50938c8-5df6-4125-bd94-94d80fae2506 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:51.811057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50938c8-5df6-4125-bd94-94d80fae2506 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:51.812017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50938c8-5df6-4125-bd94-94d80fae2506 None admin] RBAC: Adding query filter params (name=network) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:51.812528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50938c8-5df6-4125-bd94-94d80fae2506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:51.815143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50938c8-5df6-4125-bd94-94d80fae2506 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:51.823453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 380/764] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:17:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:51.829301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a76ac-5ad5-4eb6-b922-fa4479adbfdc None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:51.830168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a76ac-5ad5-4eb6-b922-fa4479adbfdc None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:51.830168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a76ac-5ad5-4eb6-b922-fa4479adbfdc None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:51.831665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 381/765] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:51.834164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a76ac-5ad5-4eb6-b922-fa4479adbfdc None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:51.864586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfc842-34a2-4d29-a089-62dfd688881e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:51.868430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfc842-34a2-4d29-a089-62dfd688881e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:52.018690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:52.031075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a76ac-5ad5-4eb6-b922-fa4479adbfdc None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:52.055525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 385/766] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:17:52.059379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab355-6fed-4bd4-bd67-cc2e9cae0ae2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:52.060174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab355-6fed-4bd4-bd67-cc2e9cae0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:52.061101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab355-6fed-4bd4-bd67-cc2e9cae0ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:52.075490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:52.076133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:52.076451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:52.076733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:52.077431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] RBAC: Adding query filter params (type=network) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:52.079435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:52.079716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:52.080110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:52.092205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 382/767] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:17:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:52.093504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:52.103470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-55aab355-6fed-4bd4-bd67-cc2e9cae0ae2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:52.107164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-55aab355-6fed-4bd4-bd67-cc2e9cae0ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:52.206675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 386/768] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:17:52.207641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aab355-6fed-4bd4-bd67-cc2e9cae0ae2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:52.320840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9574357-b354-455c-8185-cdec90582c9f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:52.373912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aab355-6fed-4bd4-bd67-cc2e9cae0ae2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:52.421339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:52.422017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:52.422287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:52.422564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:52.451208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:52.455092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:52.472251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:52.473648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:52.474318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:52.476822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:52.478870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] RBAC: Adding query filter params (interface=public, service_id=21993b61f939426fa4cdf442015345aa, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:52.479595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:52.482311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:52.486200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:52.508213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 387/769] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Sep 13 12:17:52 2022] GET /identity/v3/endpoints?service_id=21993b61f939426fa4cdf442015345aa&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:52.519411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:52.521467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:52.523802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:52.523802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:52.523802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:52.526159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:52.538537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 383/770] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:52.549157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:52.599915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:52.783887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1c997-7e9b-41af-80f2-769538e5faad None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:52.794770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e309b-dcd6-46d1-bce7-5a719f081009 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:52.849475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3dde5-9e99-48af-99f7-0444da4d79e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:52.851188 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dde5-9e99-48af-99f7-0444da4d79e8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:52.851867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dde5-9e99-48af-99f7-0444da4d79e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:52.853137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dde5-9e99-48af-99f7-0444da4d79e8 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:52.854719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3dde5-9e99-48af-99f7-0444da4d79e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:52.857792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3dde5-9e99-48af-99f7-0444da4d79e8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:52.866484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:52.867451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:52.867907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:52.868353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:52.869480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:52.869983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:52.871042 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 388/771] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:17:52 2022] GET /identity/v3/services => generated 772 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:52.872427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:52.872827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3dde5-9e99-48af-99f7-0444da4d79e8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:52.921138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 384/772] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:52.927669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:53.007110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:53.087697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3dde5-9e99-48af-99f7-0444da4d79e8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:53.161424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:53.163021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:53.163793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:53.164563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:53.166166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:53.169420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:53.187441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:53.189411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:53.190943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:53.196776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 389/773] 10.222.0.55 () {56 vars in 1129 bytes} [Tue Sep 13 12:17:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:53.203968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:53.212410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:53.289545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969f0b-19d9-402f-aa69-2593a2c96e11 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:53.338984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:53.340014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:53.340014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:53.340276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:53.349331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:53.350877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:53.365100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:53.366674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:53.368460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 385/774] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:53.374244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:53.430694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b382e8-f231-4510-a9ce-b59bddf95433 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:53.473346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:53.491013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:53.491677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:53.491938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:53.492194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:53.501372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:53.501846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:53.503839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:53.508856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 390/775] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Sep 13 12:17:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:53.518262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:53.617640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ecdbf-42c4-4957-ae30-e199c2d472ee None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:53.680996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:53.695281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:53.696900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:53.697971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:53.700802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:53.702488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:53.703947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:53.709511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:53.742597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 386/776] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:53.752765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:53.802030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098d34a-f3b6-46b8-877e-c04a5935a7a5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:53.902250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172209d2-5541-4375-9ad9-9cbb6ab2cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:53.902770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172209d2-5541-4375-9ad9-9cbb6ab2cbbe None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:53.903695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172209d2-5541-4375-9ad9-9cbb6ab2cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:53.904208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172209d2-5541-4375-9ad9-9cbb6ab2cbbe None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:53.905605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172209d2-5541-4375-9ad9-9cbb6ab2cbbe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:53.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172209d2-5541-4375-9ad9-9cbb6ab2cbbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:53.910632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172209d2-5541-4375-9ad9-9cbb6ab2cbbe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:53.926411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 391/777] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Sep 13 12:17:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:53.927270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844939c-d2ab-497e-8cda-923963db6bca None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:53.932971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2777f-a083-4fc7-8e0c-2562717c30bf None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:53.933451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2777f-a083-4fc7-8e0c-2562717c30bf None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:53.933922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2777f-a083-4fc7-8e0c-2562717c30bf None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:53.936784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 392/778] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:53.938050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2777f-a083-4fc7-8e0c-2562717c30bf None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:53.984896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a19d9-ad01-4230-a4ea-15a8bdc33da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:53.986062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a19d9-ad01-4230-a4ea-15a8bdc33da8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:53.986444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a19d9-ad01-4230-a4ea-15a8bdc33da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:53.986718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a19d9-ad01-4230-a4ea-15a8bdc33da8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:53.987498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a19d9-ad01-4230-a4ea-15a8bdc33da8 None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=f0a73e92e13c4e778dcdb2d089c64288) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:53.987812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a19d9-ad01-4230-a4ea-15a8bdc33da8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:53.989632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a19d9-ad01-4230-a4ea-15a8bdc33da8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:54.005050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 387/779] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:17:53 2022] GET /identity/v3/role_assignments?user.id=f0a73e92e13c4e778dcdb2d089c64288&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:54.008016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38c10-dd0b-46b0-8521-f227e50d3038 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:54.008403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38c10-dd0b-46b0-8521-f227e50d3038 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:54.008678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38c10-dd0b-46b0-8521-f227e50d3038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:54.037523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f3c38c10-dd0b-46b0-8521-f227e50d3038 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:54.038979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f3c38c10-dd0b-46b0-8521-f227e50d3038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:54.080043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:54.194007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:54.245165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2777f-a083-4fc7-8e0c-2562717c30bf None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:54.259848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 388/780] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:17:54.344704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410bde-9f99-4902-a423-890d6b23af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:54.346949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410bde-9f99-4902-a423-890d6b23af75 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:54.347528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410bde-9f99-4902-a423-890d6b23af75 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:54.348011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410bde-9f99-4902-a423-890d6b23af75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:54.349522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48410bde-9f99-4902-a423-890d6b23af75 None admin] RBAC: Adding query filter params (interface=public, service_id=df59382ef62849fa9f12c32370ce6f92, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:54.350047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48410bde-9f99-4902-a423-890d6b23af75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:54.352810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48410bde-9f99-4902-a423-890d6b23af75 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:54.365288 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 393/781] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Sep 13 12:17:53 2022] GET /identity/v3/endpoints?service_id=df59382ef62849fa9f12c32370ce6f92&interface=public®ion_id=RegionOne => generated 194 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:54.374365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38c10-dd0b-46b0-8521-f227e50d3038 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:54.615674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38c10-dd0b-46b0-8521-f227e50d3038 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:54.684896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fade7-2c6c-423e-b33e-43cd78b59db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:54.685889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fade7-2c6c-423e-b33e-43cd78b59db4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:54.686309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fade7-2c6c-423e-b33e-43cd78b59db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:54.686752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fade7-2c6c-423e-b33e-43cd78b59db4 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:54.687788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fade7-2c6c-423e-b33e-43cd78b59db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:54.690862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fade7-2c6c-423e-b33e-43cd78b59db4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:54.695567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2451-5c98-4b3e-8895-6dc851454038 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:54.696413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2451-5c98-4b3e-8895-6dc851454038 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:54.696556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a2451-5c98-4b3e-8895-6dc851454038 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:54.699121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 394/782] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:54.706337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb598e6-534e-43d2-9a35-88df9976c3bb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:54.706793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb598e6-534e-43d2-9a35-88df9976c3bb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:54.707285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb598e6-534e-43d2-9a35-88df9976c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:54.711605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 389/783] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:17:54 2022] GET /identity/v3/services => generated 772 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:54.766248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9cb598e6-534e-43d2-9a35-88df9976c3bb None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:54.768302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9cb598e6-534e-43d2-9a35-88df9976c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:54.821773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fade7-2c6c-423e-b33e-43cd78b59db4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:54.893856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:54.955660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fade7-2c6c-423e-b33e-43cd78b59db4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:54.982689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 395/784] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:17:55.029785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36717c-227d-415f-a693-97b908844fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:55.031329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36717c-227d-415f-a693-97b908844fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:55.032103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36717c-227d-415f-a693-97b908844fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:55.037156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36717c-227d-415f-a693-97b908844fc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:55.061912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36717c-227d-415f-a693-97b908844fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-5b36717c-227d-415f-a693-97b908844fc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:55.071832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:55.073781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:55.075455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:55.080427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 390/785] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:55.089791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb598e6-534e-43d2-9a35-88df9976c3bb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:55.196157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:55.267913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb598e6-534e-43d2-9a35-88df9976c3bb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:55.314064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:55.314719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:55.315000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:55.315275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:55.315980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:55.316354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:55.317884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:55.333853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 396/786] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:55.342809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36717c-227d-415f-a693-97b908844fc8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:55.610989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36717c-227d-415f-a693-97b908844fc8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:55.639751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:55.691175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:55.707634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:55.708710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:55.709138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:55.709562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:55.729797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:55.731317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:55.774472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:55.776173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:55.777791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:55.777791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:55.777791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:55.782340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 391/787] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:55.794907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:56.025276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcfc7b-83ad-4205-af23-d4bb5175ce35 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:56.035635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d04c-e268-48a3-b016-92e1af4d6e2f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:56.057016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:56.106836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:56.108552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:56.109483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:56.110289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:56.112437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:56.113413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:56.116573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:56.150062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 392/788] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:56.151980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:56.165852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc04be7-4ea6-4be0-879e-282b49323a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:56.166534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04be7-4ea6-4be0-879e-282b49323a63 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:56.166808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04be7-4ea6-4be0-879e-282b49323a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:56.167077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04be7-4ea6-4be0-879e-282b49323a63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:56.187739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc04be7-4ea6-4be0-879e-282b49323a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2bc04be7-4ea6-4be0-879e-282b49323a63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:56.195439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:56.197707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:56.199320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 397/789] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 507 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:56.207800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:56.215322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc04be7-4ea6-4be0-879e-282b49323a63 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:56.404636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa8e5-f846-4a52-8f97-086a1d8e2734 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:56.479362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:56.480911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:56.481722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:56.482373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:56.499550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:56.504358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:56.555754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc04be7-4ea6-4be0-879e-282b49323a63 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:56.562605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:56.564803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:17:56.566924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:56.583863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 393/790] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:17:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:56.593239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:56.644690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:56.646267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:56.646985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:56.647667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:56.649575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:56.650335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:56.653326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:56.670685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 398/791] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:17:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:56.682040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:56.762108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:56.866041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:56.911994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4fb76-6832-4a42-aa0d-1b7005a52a39 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:56.936308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da985d-8501-499c-86f5-109ff7b0d5b9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:56.984994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:56.986521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:56.987321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:56.987962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:57.010480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:57.014179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:57.046344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:57.049254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:57.051161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:57.051161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:57.051161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:57.054268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 399/792] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:57.065378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:57.093544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:57.094755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:57.095500 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:57.096179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:57.097891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:57.102048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:57.106243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:57.173917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 394/793] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Sep 13 12:17:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 589 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:57.180535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:57.281126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:57.302440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1194a-b1dc-4a4c-9ebe-b1f78d3af86c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:57.398780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8177c5-47c2-4be7-a627-341b0524c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:57.400421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8177c5-47c2-4be7-a627-341b0524c858 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:57.401307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8177c5-47c2-4be7-a627-341b0524c858 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:57.402030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8177c5-47c2-4be7-a627-341b0524c858 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:57.403530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8177c5-47c2-4be7-a627-341b0524c858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:57.404328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8177c5-47c2-4be7-a627-341b0524c858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:57.409154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8177c5-47c2-4be7-a627-341b0524c858 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:57.434297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 400/794] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:57.437200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd219-1f81-4e8d-b707-51cadfcd4eee None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:57.437937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd219-1f81-4e8d-b707-51cadfcd4eee None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:57.439037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd219-1f81-4e8d-b707-51cadfcd4eee None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:57.442564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 401/795] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:57.453398 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd219-1f81-4e8d-b707-51cadfcd4eee None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:57.488515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998afb9-105b-4247-b20c-238b4fe64352 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:57.529936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d7ca0-33ea-4011-8103-3f980f2a308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:57.530608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7ca0-33ea-4011-8103-3f980f2a308a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:57.530889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7ca0-33ea-4011-8103-3f980f2a308a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:57.531228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d7ca0-33ea-4011-8103-3f980f2a308a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:57.541692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:57.544038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d7ca0-33ea-4011-8103-3f980f2a308a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:57.546149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d7ca0-33ea-4011-8103-3f980f2a308a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-579d7ca0-33ea-4011-8103-3f980f2a308a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:57.564693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:57.566707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:57.568485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:57.568485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:57.568485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:57.573947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 395/796] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:17:57.573947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12095d-d324-4a09-94e8-e6f3848a1f22 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:57.573947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12095d-d324-4a09-94e8-e6f3848a1f22 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:57.573947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12095d-d324-4a09-94e8-e6f3848a1f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:57.594540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3b12095d-d324-4a09-94e8-e6f3848a1f22 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:57.595186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3b12095d-d324-4a09-94e8-e6f3848a1f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:57.688565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 396/797] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:17:57.688565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12095d-d324-4a09-94e8-e6f3848a1f22 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:57.718864 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd219-1f81-4e8d-b707-51cadfcd4eee None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:57.819344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:57.820218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:57.820596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:57.820907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:57.846054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:57.851609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:17:57.880166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:57.882141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:17:57.883821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:57.886196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 402/798] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:17:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:57.895424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:57.900253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:57.901850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12095d-d324-4a09-94e8-e6f3848a1f22 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:57.960037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:57.992669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3d997-846e-42df-97ed-84f4bd3cacb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:57.993376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d997-846e-42df-97ed-84f4bd3cacb8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:57.993654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d997-846e-42df-97ed-84f4bd3cacb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:57.993927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d997-846e-42df-97ed-84f4bd3cacb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:57.994662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d997-846e-42df-97ed-84f4bd3cacb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:57.994972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d997-846e-42df-97ed-84f4bd3cacb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:57.996452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d997-846e-42df-97ed-84f4bd3cacb8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:58.010682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 397/799] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:58.012084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7a4d-512f-48c5-8b65-47eb62cad863 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.012372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7a4d-512f-48c5-8b65-47eb62cad863 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.017666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7a4d-512f-48c5-8b65-47eb62cad863 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.019596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 398/800] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:58.020522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c7a4d-512f-48c5-8b65-47eb62cad863 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:58.085785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bdcdd-d081-40d0-9c53-c4331c9dae67 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:58.124882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d63f6-6680-4e06-9012-28bb7e44c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:58.125511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d63f6-6680-4e06-9012-28bb7e44c2ac None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.125832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d63f6-6680-4e06-9012-28bb7e44c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.126598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d63f6-6680-4e06-9012-28bb7e44c2ac None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.126905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d63f6-6680-4e06-9012-28bb7e44c2ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:58.127219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d63f6-6680-4e06-9012-28bb7e44c2ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:58.128734 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d63f6-6680-4e06-9012-28bb7e44c2ac None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:58.149893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 403/801] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:17:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:17:58.153802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c7a4d-512f-48c5-8b65-47eb62cad863 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:58.156113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf5b5-cf02-4808-9369-0fe305ffc5ab None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.156470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf5b5-cf02-4808-9369-0fe305ffc5ab None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.157609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf5b5-cf02-4808-9369-0fe305ffc5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.176607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f5cdf5b5-cf02-4808-9369-0fe305ffc5ab None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:58.177852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f5cdf5b5-cf02-4808-9369-0fe305ffc5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:58.196428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff15b3-aece-4626-aabd-d117ff1d80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:58.197124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff15b3-aece-4626-aabd-d117ff1d80bd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.197400 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff15b3-aece-4626-aabd-d117ff1d80bd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.197718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff15b3-aece-4626-aabd-d117ff1d80bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.207151 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff15b3-aece-4626-aabd-d117ff1d80bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:58.208725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff15b3-aece-4626-aabd-d117ff1d80bd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-5aff15b3-aece-4626-aabd-d117ff1d80bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:17:58.222191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:58.223208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:58.224112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 399/802] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:58.224996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8940-196b-483b-b35f-b66446e11a6c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.224996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8940-196b-483b-b35f-b66446e11a6c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.225252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a8940-196b-483b-b35f-b66446e11a6c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.231001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 400/803] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:17:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:58.231987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a8940-196b-483b-b35f-b66446e11a6c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:58.252987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:58.266375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 404/804] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:17:58.267220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdf5b5-cf02-4808-9369-0fe305ffc5ab None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:58.309231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:58.410829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a8940-196b-483b-b35f-b66446e11a6c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:58.420022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdf5b5-cf02-4808-9369-0fe305ffc5ab None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:58.456781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bed757-c36c-418f-9c78-39b9d9471559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:58.457414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bed757-c36c-418f-9c78-39b9d9471559 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.457694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bed757-c36c-418f-9c78-39b9d9471559 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.457969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bed757-c36c-418f-9c78-39b9d9471559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.492828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51415-00ca-47d0-a885-1aed604fcc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:58.494303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51415-00ca-47d0-a885-1aed604fcc5a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.495027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51415-00ca-47d0-a885-1aed604fcc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.495790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51415-00ca-47d0-a885-1aed604fcc5a None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.496727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51415-00ca-47d0-a885-1aed604fcc5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:58.497167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51415-00ca-47d0-a885-1aed604fcc5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:58.499942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51415-00ca-47d0-a885-1aed604fcc5a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:58.530966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 405/805] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:17:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:58.530966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34540e5-4297-4a46-bc3a-de1fecd68bc3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.530966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34540e5-4297-4a46-bc3a-de1fecd68bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.530966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34540e5-4297-4a46-bc3a-de1fecd68bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.555457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b34540e5-4297-4a46-bc3a-de1fecd68bc3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:58.557256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b34540e5-4297-4a46-bc3a-de1fecd68bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:58.580707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bed757-c36c-418f-9c78-39b9d9471559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:58.582327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bed757-c36c-418f-9c78-39b9d9471559 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:58.633257 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:58.643814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:58.670433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 406/806] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:17:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:17:58.671527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34540e5-4297-4a46-bc3a-de1fecd68bc3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:58.730415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 401/807] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:17:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:17:58.731428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bed757-c36c-418f-9c78-39b9d9471559 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:58.828047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34540e5-4297-4a46-bc3a-de1fecd68bc3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:58.886362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:58.887183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.887603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.888033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.888908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:58.890788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:58.903009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:58.905067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:17:58.906706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:58.911296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bed757-c36c-418f-9c78-39b9d9471559 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:58.911887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 407/808] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:17:58 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:58.911887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:58.961555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2d0af-6fb4-4e29-a98f-ec25b0a48dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:58.962510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2d0af-6fb4-4e29-a98f-ec25b0a48dd8 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:58.962971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2d0af-6fb4-4e29-a98f-ec25b0a48dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:58.963436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2d0af-6fb4-4e29-a98f-ec25b0a48dd8 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/149aa4c99a33498282eb285ddebe89d5/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:58.966683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2d0af-6fb4-4e29-a98f-ec25b0a48dd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=149aa4c99a33498282eb285ddebe89d5, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:58.969015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2d0af-6fb4-4e29-a98f-ec25b0a48dd8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:58.991585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 402/809] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:17:58 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/149aa4c99a33498282eb285ddebe89d5/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:17:58.992949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2d0af-6fb4-4e29-a98f-ec25b0a48dd8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:58.996213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:59.007576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:59.131381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee04a3-f913-4bb2-a4d8-470e671ec3a7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:59.190872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2d0af-6fb4-4e29-a98f-ec25b0a48dd8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:59.191101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:59.191727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:59.192010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:59.192286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:59.192937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:59.194393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:59.205077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:59.206331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:17:59.207167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 408/810] 10.222.0.55 () {56 vars in 1129 bytes} [Tue Sep 13 12:17:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:59.208843 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:59.271383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:59.272346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:59.272833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:59.273157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:59.287631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:59.289717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:17:59.311842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:59.314621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:17:59.316666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:17:59.316666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:17:59.316666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:59.320175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 403/811] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:59.321100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:59.402421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce109f2-c441-4cb7-a2ec-f0cc4e506fae None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:59.414247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:59.427106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:59.479007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:59.479705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:59.480067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:59.480551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:59.481594 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] RBAC: Adding query filter params (name=network) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:59.482083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:59.484518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:59.492258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 409/812] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:17:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:59.492258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:59.510961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67193afc-3067-4349-9e64-1efe67f0b148 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:59.555823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8eb2-61db-4d7d-8644-4b29a09fedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:59.556363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8eb2-61db-4d7d-8644-4b29a09fedf7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:59.556761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8eb2-61db-4d7d-8644-4b29a09fedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:59.556916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8eb2-61db-4d7d-8644-4b29a09fedf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:59.570429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e8eb2-61db-4d7d-8644-4b29a09fedf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-326e8eb2-61db-4d7d-8644-4b29a09fedf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:17:59.575985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:17:59.577825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 404/813] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:17:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:17:59.580176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8eb2-61db-4d7d-8644-4b29a09fedf7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:59.661539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b29b-988d-4576-a49d-5810a2522efe None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:59.702711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8eb2-61db-4d7d-8644-4b29a09fedf7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:59.718757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:59.737299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:59.738199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:59.738613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:59.739030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:59.740244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:59.740764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:59.743397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:59.751484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:59.752467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:59.752846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:59.753285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:59.754187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:59.754592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:59.756191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:59.759412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 410/814] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Sep 13 12:17:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:59.760989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:59.780016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 405/815] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:17:59.781278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:59.828917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:59.936132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2464-d051-40aa-9125-e1b3afdd2278 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:59.949918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ddcc1-8ba1-4d3a-a274-6bc8c6b7c8c7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:59.983526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:59.984156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:59.984481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:59.984724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:59.985398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:17:59.985799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:59.987983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:00.001436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 406/816] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:00.002623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:00.012848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:00.013802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:00.014229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:00.014650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:00.015511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] RBAC: Adding query filter params (type=network) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:00.016171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:00.017998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:00.025106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 411/817] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:17:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:00.026451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:00.082640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:00.153499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1d032-7b5e-4a74-9ee5-7d30b8152f0f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:00.156322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:00.204526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:00.205592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:00.206052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:00.206465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:00.215869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:00.217438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b360-1284-4e09-8b5c-14f2e8cc9337 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:00.217867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:00.232689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:00.233971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:00.235176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:00.235176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:00.235176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:00.235176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:00.235176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:00.235176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:00.235176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:00.235176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:00.242925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 412/818] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:00.242925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:00.293677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:00.294609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:00.295006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:00.295390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:00.296323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:00.296819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:00.299049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:00.312485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 407/819] 10.222.0.55 () {56 vars in 1124 bytes} [Tue Sep 13 12:18:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:00.312485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:00.429334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a5bf9-7ce3-476f-a994-5d5fb2bf8269 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:00.474416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:00.479727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a338041-2caa-4f85-8ef1-5875ed90e4b2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:00.500721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:00.501792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:00.502040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:00.502535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:00.523206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:00.525703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:00.544307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f22c-323a-4c9a-8aac-e942bdf9830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:00.545303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f22c-323a-4c9a-8aac-e942bdf9830c None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:00.545757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f22c-323a-4c9a-8aac-e942bdf9830c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:00.546193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f22c-323a-4c9a-8aac-e942bdf9830c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:00.547340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498f22c-323a-4c9a-8aac-e942bdf9830c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:00.550505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498f22c-323a-4c9a-8aac-e942bdf9830c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:00.551920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:00.562164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:00.565268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:00.565268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:00.565268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:00.565268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 413/820] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:00.565268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:00.612427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 408/821] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:18:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:00.612427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f22c-323a-4c9a-8aac-e942bdf9830c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:00.785747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:00.850038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f22c-323a-4c9a-8aac-e942bdf9830c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:00.942862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85969e6b-90cf-4df1-a39e-d41fcbaa2bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:00.945145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969e6b-90cf-4df1-a39e-d41fcbaa2bdf None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:00.946027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969e6b-90cf-4df1-a39e-d41fcbaa2bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:00.946806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85969e6b-90cf-4df1-a39e-d41fcbaa2bdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:00.948452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85969e6b-90cf-4df1-a39e-d41fcbaa2bdf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:00.952822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85969e6b-90cf-4df1-a39e-d41fcbaa2bdf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:00.953093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218b838-64c7-43c1-8c93-913448dcea97 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:00.993135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 409/822] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:18:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:00.994558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85969e6b-90cf-4df1-a39e-d41fcbaa2bdf None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:01.021924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:01.053968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:01.055121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:01.055600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:01.056054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:01.057416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:01.057952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:01.060907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:01.096900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 414/823] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 542 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:01.106213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:01.227274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85969e6b-90cf-4df1-a39e-d41fcbaa2bdf None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:01.286523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:01.297321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:01.298615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:01.299269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:01.300827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:01.301276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:01.303415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:01.304544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:01.329611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a0e49-704e-49e3-b886-5fb7aed0af45 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:01.330344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 410/824] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:01.337223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:01.408347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:01.409520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:01.410075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:01.410609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:01.412060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=536e042f0d76408b9379af15526878b3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:01.412717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:01.417424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:01.430985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 415/825] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:01 2022] GET /identity/v3/role_assignments?user.id=536e042f0d76408b9379af15526878b3&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:01.495887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:01.576437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16599029-8d3a-4b14-b09b-97a440b98544 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:01.649559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa288c3f-4a77-49d8-ad14-9b49dba40555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:01.650734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa288c3f-4a77-49d8-ad14-9b49dba40555 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:01.651226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa288c3f-4a77-49d8-ad14-9b49dba40555 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:01.651713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa288c3f-4a77-49d8-ad14-9b49dba40555 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:01.667074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa288c3f-4a77-49d8-ad14-9b49dba40555 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:01.670003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa288c3f-4a77-49d8-ad14-9b49dba40555 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-fa288c3f-4a77-49d8-ad14-9b49dba40555 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:01.695014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:01.696873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:01.698685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 411/826] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:18:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:01.705628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:01.919481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03561b-8e7a-49f0-9cc1-f9a4f4b7621d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:01.943164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a86db5-82d1-4b6a-96f4-f98ed18b6c9b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:01.943709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a86db5-82d1-4b6a-96f4-f98ed18b6c9b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:01.944123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a86db5-82d1-4b6a-96f4-f98ed18b6c9b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:01.952582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 412/827] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:01.956875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada5d1-5480-416f-aa4f-fb1f582d2400 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:01.957366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada5d1-5480-416f-aa4f-fb1f582d2400 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:01.957839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada5d1-5480-416f-aa4f-fb1f582d2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:01.987129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:01.988164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:01.988661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:01.989120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:01.989281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-46ada5d1-5480-416f-aa4f-fb1f582d2400 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:01.990488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:01.991025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:01.991304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-46ada5d1-5480-416f-aa4f-fb1f582d2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:01.993804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:01.999031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:02.039903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 416/828] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Sep 13 12:18:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:02.046264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:02.110833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 413/829] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:02.254147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d34b0-4d6c-4f9d-b795-45084126d2b1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:02.317725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:02.318832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:02.319319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:02.319804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:02.341329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:02.344219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:02.374942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:02.376028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:02.376983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:02.376983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:02.376983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:02.377566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 417/830] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:02.383525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ada5d1-5480-416f-aa4f-fb1f582d2400 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:02.456806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:02.499481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ada5d1-5480-416f-aa4f-fb1f582d2400 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:02.541194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:02.542094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:02.542661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:02.543079 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:02.544009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:02.544512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:02.546238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:02.560374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 414/831] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:02.573681 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:02.611212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:02.660850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:02.765691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77452458-d8e1-4012-98f6-342edd2eceec None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:02.782019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d017c-d9b2-4cf7-8a70-6fbb868a21fe None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:02.816444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:02.835925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87368-e266-49dd-85e2-23d1254a38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:02.837019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87368-e266-49dd-85e2-23d1254a38f7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:02.837483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87368-e266-49dd-85e2-23d1254a38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:02.837978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87368-e266-49dd-85e2-23d1254a38f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:02.846928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:02.848066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:02.849100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:02.849615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:02.854474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a87368-e266-49dd-85e2-23d1254a38f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-11a87368-e266-49dd-85e2-23d1254a38f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:02.860684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:02.861803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:18:02.862637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:02.865505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 415/832] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:02.868643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:02.870549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:02.877398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87368-e266-49dd-85e2-23d1254a38f7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:02.886026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:02.886979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:02.887870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:02.887870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:02.887870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:02.887870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:02.887870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:02.887870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:02.887870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:02.887870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:02.890423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 418/833] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:02.896797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:03.023066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005497c-1349-4552-8e8a-d9fd8589bf2c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:03.026835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:03.068983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:03.070046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:03.070628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:03.071119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:03.072223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:03.072785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:03.074481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:03.076929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87368-e266-49dd-85e2-23d1254a38f7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:03.095872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 419/834] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:03.097337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:03.145181 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:03.146262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:03.146760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:03.147254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:03.148884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:03.149443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:03.152188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:03.171016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 416/835] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:18:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:03.179946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:03.255889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4078c-e535-48e4-a56d-ed8f92d3fc42 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:03.267272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:03.327027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aead0-9c1a-4259-8255-1f8fab344693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:03.327993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aead0-9c1a-4259-8255-1f8fab344693 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:03.328508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aead0-9c1a-4259-8255-1f8fab344693 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:03.328974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155aead0-9c1a-4259-8255-1f8fab344693 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/f0a73e92e13c4e778dcdb2d089c64288/roles/e45cf88b951c40d793eb810b5b33c8de` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:03.360677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155aead0-9c1a-4259-8255-1f8fab344693 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=f0a73e92e13c4e778dcdb2d089c64288, role_id=e45cf88b951c40d793eb810b5b33c8de)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:03.363578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155aead0-9c1a-4259-8255-1f8fab344693 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:03.389271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 420/836] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:18:03 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/f0a73e92e13c4e778dcdb2d089c64288/roles/e45cf88b951c40d793eb810b5b33c8de => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:18:03.394575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45903a-c473-4b2e-bb05-f6e2cfe7723c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:03.481037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:03.482923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:03.483867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:03.484772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:03.509053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:03.511910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:03.543807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:03.546528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:03.547723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:03.547723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:03.547723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:03.547723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 417/837] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:03.559134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aead0-9c1a-4259-8255-1f8fab344693 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:03.593386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:03.757728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155aead0-9c1a-4259-8255-1f8fab344693 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:03.827009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d3533-3aac-42ee-8cca-a730d9be96e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:03.829942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d3533-3aac-42ee-8cca-a730d9be96e0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:03.830859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d3533-3aac-42ee-8cca-a730d9be96e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:03.831859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d3533-3aac-42ee-8cca-a730d9be96e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:03.833524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d3533-3aac-42ee-8cca-a730d9be96e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:03.834401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d3533-3aac-42ee-8cca-a730d9be96e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:03.837409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d3533-3aac-42ee-8cca-a730d9be96e0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:03.860982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 421/838] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:03.871620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:04.005810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:04.015699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c41642-80c7-4394-8dd8-dad9c9f8b64d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:04.055859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:04.056543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:04.056826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:04.057102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:04.067220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:04.068773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:04.074813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089c28-cf23-4162-bfa1-3812bd0814ef None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:04.075073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089c28-cf23-4162-bfa1-3812bd0814ef None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:04.075391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089c28-cf23-4162-bfa1-3812bd0814ef None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:04.077090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 422/839] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:04.081771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:04.084783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 12:18:04.086776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:04.087852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6726eb9-1793-4ea2-a0c4-9ba6bf95b170 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:04.087996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 418/840] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:18:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:04.088129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6726eb9-1793-4ea2-a0c4-9ba6bf95b170 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:04.088129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6726eb9-1793-4ea2-a0c4-9ba6bf95b170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:04.100161 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:04.104757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d6726eb9-1793-4ea2-a0c4-9ba6bf95b170 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:04.106060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d6726eb9-1793-4ea2-a0c4-9ba6bf95b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:04.235044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 423/841] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:04.255420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f93ce3-f0a4-4d26-8449-2bff2495f72a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:04.302211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfbfe4-648f-4aad-8294-33538c95404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:04.302848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfbfe4-648f-4aad-8294-33538c95404a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:04.303174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfbfe4-648f-4aad-8294-33538c95404a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:04.303449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfbfe4-648f-4aad-8294-33538c95404a None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:04.304236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfbfe4-648f-4aad-8294-33538c95404a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:04.304584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfbfe4-648f-4aad-8294-33538c95404a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:04.306199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfbfe4-648f-4aad-8294-33538c95404a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:04.331869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 419/842] 10.222.0.55 () {56 vars in 1135 bytes} [Tue Sep 13 12:18:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:04.338193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6726eb9-1793-4ea2-a0c4-9ba6bf95b170 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:04.342861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:04.466790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448f24-2881-4b76-8f38-ec9740f12d5b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:04.467340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448f24-2881-4b76-8f38-ec9740f12d5b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:04.467518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448f24-2881-4b76-8f38-ec9740f12d5b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:04.476121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 420/843] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:04 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:04.489865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a279f1-ac00-48bd-8ddc-91024014c75f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:04.490117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a279f1-ac00-48bd-8ddc-91024014c75f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:04.490448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a279f1-ac00-48bd-8ddc-91024014c75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:04.530032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-16a279f1-ac00-48bd-8ddc-91024014c75f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:04.530340 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6726eb9-1793-4ea2-a0c4-9ba6bf95b170 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:04.532505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-16a279f1-ac00-48bd-8ddc-91024014c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:04.539362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:04.580821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825333bc-190d-4eb4-8d92-9274c78ed462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:04.581473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825333bc-190d-4eb4-8d92-9274c78ed462 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:04.581743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825333bc-190d-4eb4-8d92-9274c78ed462 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:04.582016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825333bc-190d-4eb4-8d92-9274c78ed462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:04.670579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 421/844] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:04.676981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a279f1-ac00-48bd-8ddc-91024014c75f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:04.695765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825333bc-190d-4eb4-8d92-9274c78ed462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:04.699723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825333bc-190d-4eb4-8d92-9274c78ed462 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:04.707975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:04.846484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 424/845] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:18:04.863473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825333bc-190d-4eb4-8d92-9274c78ed462 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:04.868213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a279f1-ac00-48bd-8ddc-91024014c75f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:04.942269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:04.943357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:04.944259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:04.944786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:04.947493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:04.950098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:04.969285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:04.971742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:04.973472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 422/846] 10.222.0.55 () {56 vars in 1132 bytes} [Tue Sep 13 12:18:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:04.974963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:04.984015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:05.068525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825333bc-190d-4eb4-8d92-9274c78ed462 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:05.071499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:05.115172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:05.115746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:05.116026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:05.116313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:05.136375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3cfc-c038-4b62-aba7-1e3f7431e3ef None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:05.139608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:05.141616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:05.163360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:05.164464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:05.165389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:05.165389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:05.165389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:05.169089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 425/847] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:05.170474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:05.186018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:05.187326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:05.187614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:05.187885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:05.188637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:05.190286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:05.201251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:05.202326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:05.203143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:05.207676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 423/848] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:05.208700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:05.291829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:05.336026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bd9de-d92f-4602-9e6d-7baa9baa84f0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:05.343553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8aad6-76c9-438a-8c2a-01dfc1511b89 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:05.386868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:05.387809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:05.388241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:05.388711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:05.389635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:05.390112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:05.392592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:05.406490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:05.407559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:05.407987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:05.408495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:05.409459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:05.409889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:05.412242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:05.419682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 424/849] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:05.419682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:05.427145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 426/850] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:05.428489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:05.473627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:05.633792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c3501-d21a-4bcb-8819-2480b27317a3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:05.705588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:05.706618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:05.707109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:05.707587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:05.708744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f08f26-cff5-4a7d-82b8-0c76f71b785b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:05.720819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:05.723556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:05.745844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:05.747634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 427/851] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:05.750194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:05.761509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:05.776956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:05.777965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:05.778441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:05.778926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:05.780123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:05.780698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:05.784096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:05.792882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 425/852] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:05.794336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:05.871935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:05.903643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cedafb-67fb-4d0c-8df2-90a047837e90 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:05.948260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:05.949360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:05.950993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:05.950993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:05.951307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:05.951622 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:05.953037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:05.959888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 428/853] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:05.961863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:06.024866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a61a55-b1ab-4643-b90e-36a13a3d3049 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:06.111596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:06.113030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:06.113543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:06.114035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:06.115798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:06.116461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:06.118584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:06.139036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 426/854] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:06.153412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:06.171418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f9c56-9078-43c9-9302-de872a956bdf None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:06.231750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de919360-6a3b-4c65-be84-47de91f1ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:06.232368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de919360-6a3b-4c65-be84-47de91f1ae71 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:06.232687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de919360-6a3b-4c65-be84-47de91f1ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:06.232963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de919360-6a3b-4c65-be84-47de91f1ae71 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:06.233646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de919360-6a3b-4c65-be84-47de91f1ae71 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:06.233951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de919360-6a3b-4c65-be84-47de91f1ae71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:06.235692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de919360-6a3b-4c65-be84-47de91f1ae71 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:06.241516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 429/855] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:06.297288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:06.298409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7890ab-c3f1-4015-a2ff-4273100dfa9d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:06.298705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7890ab-c3f1-4015-a2ff-4273100dfa9d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:06.298990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7890ab-c3f1-4015-a2ff-4273100dfa9d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:06.300973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 430/856] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:06.309790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3f8b-3d0e-4fae-8332-f04a318673ee None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:06.310369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3f8b-3d0e-4fae-8332-f04a318673ee None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:06.310872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3f8b-3d0e-4fae-8332-f04a318673ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:06.342772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1dde3f8b-3d0e-4fae-8332-f04a318673ee None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:06.345038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1dde3f8b-3d0e-4fae-8332-f04a318673ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:06.349213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:06.394323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381af2-9ea6-4fdb-9bd8-07edd33d7d0f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:06.453986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 431/857] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:06.465721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:06.466703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:06.466978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:06.467247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:06.468014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=149aa4c99a33498282eb285ddebe89d5) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:06.468320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:06.469917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:06.480208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 427/858] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:06 2022] GET /identity/v3/role_assignments?user.id=149aa4c99a33498282eb285ddebe89d5&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:06.941839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3f8b-3d0e-4fae-8332-f04a318673ee None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:07.151377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3f8b-3d0e-4fae-8332-f04a318673ee None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:07.223217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba688-7b4a-43c0-a7a3-92cfda533a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:07.224255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba688-7b4a-43c0-a7a3-92cfda533a36 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:07.224814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba688-7b4a-43c0-a7a3-92cfda533a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:07.225287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba688-7b4a-43c0-a7a3-92cfda533a36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:07.242185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:07.250807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eba688-7b4a-43c0-a7a3-92cfda533a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b3eba688-7b4a-43c0-a7a3-92cfda533a36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:07.260204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:07.261381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:18:07.262206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:07.262834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 432/859] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:18:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:07.272342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:07.411705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b1493-482d-4601-94ef-f586cdd6f873 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:07.435934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:07.469653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:07.470811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:07.471292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:07.471793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:07.472752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:07.473335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:07.474985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:07.486192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 428/860] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:18:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:07.496663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba688-7b4a-43c0-a7a3-92cfda533a36 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:07.702077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba688-7b4a-43c0-a7a3-92cfda533a36 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:07.772729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:07.773869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:07.774372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:07.774851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:07.796258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:07.799316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:07.830552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:07.832451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:07.834300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:07.834300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:07.834300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:07.834300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 433/861] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:07.842095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:08.042617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbeabb-a8aa-4901-9ef8-051654ce252d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:08.086112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:08.086749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:08.087029 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:08.087308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:08.087973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:08.088275 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:08.089760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:08.103630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 429/862] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:08.112610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:08.211814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:08.322396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8d25-b9a8-45c4-89a5-4851e84f0410 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:08.396081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:08.397460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:08.397942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:08.398743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:08.414750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:08.417516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:08.441052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:08.442932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:08.445245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 434/863] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:18:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:08.452951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:08.544084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:08.655765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0ec98-e859-44ed-9f3e-b4057bc7c16a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:08.696639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77b1b3-fd42-483f-9eda-6147ddf3bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:08.697277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b1b3-fd42-483f-9eda-6147ddf3bd38 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:08.697567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b1b3-fd42-483f-9eda-6147ddf3bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:08.697822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b1b3-fd42-483f-9eda-6147ddf3bd38 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:08.698598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77b1b3-fd42-483f-9eda-6147ddf3bd38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:08.698910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77b1b3-fd42-483f-9eda-6147ddf3bd38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:08.700495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77b1b3-fd42-483f-9eda-6147ddf3bd38 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:08.721879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 430/864] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Sep 13 12:18:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:08.730808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:08.743084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4696-6b9f-4ac2-a97c-bcdf83fa651a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:08.743525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4696-6b9f-4ac2-a97c-bcdf83fa651a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:08.744009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4696-6b9f-4ac2-a97c-bcdf83fa651a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:08.747050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 431/865] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:08.755882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d08e88-e5ae-45e6-bbe3-8a106e059498 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:08.756209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d08e88-e5ae-45e6-bbe3-8a106e059498 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:08.756452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d08e88-e5ae-45e6-bbe3-8a106e059498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:08.778282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-92d08e88-e5ae-45e6-bbe3-8a106e059498 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:08.781976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-92d08e88-e5ae-45e6-bbe3-8a106e059498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:08.864964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 432/866] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:08.930198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430ca7-c167-4925-b523-0dbe3f953795 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:08.952826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:08.984981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927969b1-4ac4-4129-8894-dc1bc566d50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:08.985800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927969b1-4ac4-4129-8894-dc1bc566d50e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:08.986089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927969b1-4ac4-4129-8894-dc1bc566d50e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:08.986382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927969b1-4ac4-4129-8894-dc1bc566d50e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:09.070505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927969b1-4ac4-4129-8894-dc1bc566d50e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:09.072002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927969b1-4ac4-4129-8894-dc1bc566d50e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:09.194716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 435/867] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:18:09.203494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d08e88-e5ae-45e6-bbe3-8a106e059498 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:09.256192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:09.319873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927969b1-4ac4-4129-8894-dc1bc566d50e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:09.345365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:09.365374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d08e88-e5ae-45e6-bbe3-8a106e059498 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:09.416339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:09.418006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:09.418785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:09.419586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:09.440608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:09.443947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:09.474052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:09.476993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:09.478692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:09.478692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:09.478692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:09.486552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927969b1-4ac4-4129-8894-dc1bc566d50e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:09.487506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 433/868] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:09.492205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:09.542700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771c126-9edb-4bca-aff4-1d3297bb45e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:09.543762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c126-9edb-4bca-aff4-1d3297bb45e2 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:09.544243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c126-9edb-4bca-aff4-1d3297bb45e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:09.544769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c126-9edb-4bca-aff4-1d3297bb45e2 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:09.545987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771c126-9edb-4bca-aff4-1d3297bb45e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:09.548740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771c126-9edb-4bca-aff4-1d3297bb45e2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:09.575823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 436/869] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:18:09 2022] POST /identity/v3/services => generated 269 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:09.575823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5761a-5c45-44c8-9473-7b92269c2ef9 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:09.575823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5761a-5c45-44c8-9473-7b92269c2ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:09.575823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5761a-5c45-44c8-9473-7b92269c2ef9 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:09.575823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 437/870] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:09.583543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf4df-1f69-4bf3-8dc5-e72b76937427 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:09.583543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf4df-1f69-4bf3-8dc5-e72b76937427 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:09.583543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf4df-1f69-4bf3-8dc5-e72b76937427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:09.607477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1c4cf4df-1f69-4bf3-8dc5-e72b76937427 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:09.608898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1c4cf4df-1f69-4bf3-8dc5-e72b76937427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:09.640199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:09.692778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a979e4-4fb3-4ade-9eee-2d37cc9f43f0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:09.729933 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:09.753553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 438/871] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:09 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:09.768700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741ecbb-6e56-4994-8a05-b60471be5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:09.769729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ecbb-6e56-4994-8a05-b60471be5634 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:09.770178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ecbb-6e56-4994-8a05-b60471be5634 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:09.770624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ecbb-6e56-4994-8a05-b60471be5634 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:09.771867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741ecbb-6e56-4994-8a05-b60471be5634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:09.772453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741ecbb-6e56-4994-8a05-b60471be5634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:09.775105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741ecbb-6e56-4994-8a05-b60471be5634 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:09.793366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 434/872] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:09.802874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cf4df-1f69-4bf3-8dc5-e72b76937427 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:09.892284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3f59-c923-4798-bba9-b009149596d3 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:09.892727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3f59-c923-4798-bba9-b009149596d3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:09.892979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3f59-c923-4798-bba9-b009149596d3 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:09.894422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 435/873] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:09.905125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de085b-5b08-49dc-a516-1dc011d122c5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:09.906029 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de085b-5b08-49dc-a516-1dc011d122c5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:09.906746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de085b-5b08-49dc-a516-1dc011d122c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:09.939909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c6de085b-5b08-49dc-a516-1dc011d122c5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:09.943511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c6de085b-5b08-49dc-a516-1dc011d122c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:10.003198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cf4df-1f69-4bf3-8dc5-e72b76937427 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:10.062532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:10.063740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:10.063907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:10.064313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:10.068766 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 436/874] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:09 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:10.068766 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de085b-5b08-49dc-a516-1dc011d122c5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:10.083297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:10.086186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:10.108055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:10.109307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:10.110835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:10.110835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:10.110835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:10.110835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:10.110835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:10.110835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:10.110835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:10.110835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:10.116776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 439/875] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:10.119782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:10.154569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:10.199733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de085b-5b08-49dc-a516-1dc011d122c5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:10.249243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:10.257855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789043a-e848-486d-bb1b-9e5d214ae7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:10.258794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789043a-e848-486d-bb1b-9e5d214ae7ee None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:10.259273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789043a-e848-486d-bb1b-9e5d214ae7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:10.259737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789043a-e848-486d-bb1b-9e5d214ae7ee None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:10.261008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789043a-e848-486d-bb1b-9e5d214ae7ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:10.263804 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789043a-e848-486d-bb1b-9e5d214ae7ee None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:10.297838 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 437/876] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:18:10 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:10.325094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d353e3-9ed9-48e5-ab1b-cd2c26aa7fe1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:10.380146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:10.381076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:10.381541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:10.381950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:10.382827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:10.383303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:10.385013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:10.402601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 440/877] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:10.412087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789043a-e848-486d-bb1b-9e5d214ae7ee None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:10.578475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:10.597580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789043a-e848-486d-bb1b-9e5d214ae7ee None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:10.652455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:10.671261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:10.672800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:10.673747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:10.674552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:10.677271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=f0a73e92e13c4e778dcdb2d089c64288) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:10.678048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:10.682081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:10.697780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 438/878] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:10 2022] GET /identity/v3/role_assignments?user.id=f0a73e92e13c4e778dcdb2d089c64288&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:10.739241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ee2a1-161a-4f17-adb0-cde66cfb3a13 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:10.756963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:10.786720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:10.787462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:10.787737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:10.787993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:10.788632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:10.790056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:10.800830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:10.802722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:10.804285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 441/879] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:10.817723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:11.021288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354e3c-5754-4fdc-b2e4-d151f83b71fa None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:11.068259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceab6c-22ab-45ff-9fae-1843cae83cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:11.068948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceab6c-22ab-45ff-9fae-1843cae83cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:11.069221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceab6c-22ab-45ff-9fae-1843cae83cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:11.069489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceab6c-22ab-45ff-9fae-1843cae83cb7 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:11.070162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceab6c-22ab-45ff-9fae-1843cae83cb7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:11.070463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceab6c-22ab-45ff-9fae-1843cae83cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:11.071958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceab6c-22ab-45ff-9fae-1843cae83cb7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:11.078700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 439/880] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:11.086702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:11.266108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c28cb-aeb2-4e71-9d98-fbb529ad60c0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:11.307802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68492da5-55f4-4c6f-abdc-2e4e3559e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:11.308847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68492da5-55f4-4c6f-abdc-2e4e3559e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:11.309329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68492da5-55f4-4c6f-abdc-2e4e3559e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:11.309795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68492da5-55f4-4c6f-abdc-2e4e3559e6a6 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:11.310672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68492da5-55f4-4c6f-abdc-2e4e3559e6a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:11.311204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68492da5-55f4-4c6f-abdc-2e4e3559e6a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:11.312869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68492da5-55f4-4c6f-abdc-2e4e3559e6a6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:11.319462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 442/881] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:12.081265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390f9e-171d-449c-8fd0-6d4768cf67d7 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:12.081849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390f9e-171d-449c-8fd0-6d4768cf67d7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:12.081849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390f9e-171d-449c-8fd0-6d4768cf67d7 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:12.083587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 440/882] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:12.089560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f126-d819-4a27-949f-71d56b02a7c3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:12.090081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f126-d819-4a27-949f-71d56b02a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:12.090081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f126-d819-4a27-949f-71d56b02a7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:12.114723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-82a7f126-d819-4a27-949f-71d56b02a7c3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:12.116370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-82a7f126-d819-4a27-949f-71d56b02a7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:12.158021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:12.197104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 443/883] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:12.469214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3390f9e-171d-449c-8fd0-6d4768cf67d7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:12.542936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:12.602498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3390f9e-171d-449c-8fd0-6d4768cf67d7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:12.652422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:12.653090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:12.653368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:12.653638 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:12.654311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:12.655724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:12.665994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:12.666997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:12.667891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 441/884] 10.222.0.55 () {56 vars in 1132 bytes} [Tue Sep 13 12:18:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:12.674292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7f126-d819-4a27-949f-71d56b02a7c3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:12.795257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7f126-d819-4a27-949f-71d56b02a7c3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:12.835065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20186e32-c55a-4674-90c8-520761ee34a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:12.835721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20186e32-c55a-4674-90c8-520761ee34a4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:12.836002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20186e32-c55a-4674-90c8-520761ee34a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:12.836280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20186e32-c55a-4674-90c8-520761ee34a4 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:12.836966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20186e32-c55a-4674-90c8-520761ee34a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:12.837279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20186e32-c55a-4674-90c8-520761ee34a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:12.838707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20186e32-c55a-4674-90c8-520761ee34a4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:12.848847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 444/885] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:12.850721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:12.974901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c577b-5e59-45f5-a5d4-4fdd1684e470 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:12.999484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:13.016153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87e70e-244a-49bc-9ea9-a3ca5ac4faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:13.016893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e70e-244a-49bc-9ea9-a3ca5ac4faf0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.017176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e70e-244a-49bc-9ea9-a3ca5ac4faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.017483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e70e-244a-49bc-9ea9-a3ca5ac4faf0 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.018118 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87e70e-244a-49bc-9ea9-a3ca5ac4faf0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:13.018426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87e70e-244a-49bc-9ea9-a3ca5ac4faf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:13.020690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87e70e-244a-49bc-9ea9-a3ca5ac4faf0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:13.020867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd3c7-0f29-42c0-be86-dbf751ff8d00 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.021156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd3c7-0f29-42c0-be86-dbf751ff8d00 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.021430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd3c7-0f29-42c0-be86-dbf751ff8d00 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.027093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 442/887] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:13.027311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 445/887] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:13.030020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc459-c2bc-486f-9079-9c7a448e4799 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.030302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc459-c2bc-486f-9079-9c7a448e4799 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.030561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc459-c2bc-486f-9079-9c7a448e4799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.033258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd3c7-0f29-42c0-be86-dbf751ff8d00 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:13.054312 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-af4bc459-c2bc-486f-9079-9c7a448e4799 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:13.055449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-af4bc459-c2bc-486f-9079-9c7a448e4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:13.081075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:13.144596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 443/888] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:13.168221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd3c7-0f29-42c0-be86-dbf751ff8d00 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:13.207948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:13.209001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.209483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.209957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.210928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] RBAC: Adding query filter params (interface=public, service_id=3844643d934b479fbb46045f82cf3a13, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:13.211437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:13.213063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:13.219948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 446/889] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Sep 13 12:18:13 2022] GET /identity/v3/endpoints?service_id=3844643d934b479fbb46045f82cf3a13&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:13.226400 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc459-c2bc-486f-9079-9c7a448e4799 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:13.337678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc459-c2bc-486f-9079-9c7a448e4799 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:13.375016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:13.378650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ebe41-57d3-4a30-824a-3d77fb71d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:13.379294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ebe41-57d3-4a30-824a-3d77fb71d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.379568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ebe41-57d3-4a30-824a-3d77fb71d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.379836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ebe41-57d3-4a30-824a-3d77fb71d1c5 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.380504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ebe41-57d3-4a30-824a-3d77fb71d1c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:13.381923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ebe41-57d3-4a30-824a-3d77fb71d1c5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:13.388628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 444/890] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:18:13 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:18:13.433429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:13.565228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:13.576417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c742a-bf6d-476b-be32-33fd7bb0eab3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:13.614882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418ae31-50a0-4515-839c-14c298b123cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:13.615476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418ae31-50a0-4515-839c-14c298b123cb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.615753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418ae31-50a0-4515-839c-14c298b123cb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.616021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418ae31-50a0-4515-839c-14c298b123cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.616661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418ae31-50a0-4515-839c-14c298b123cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:13.618098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418ae31-50a0-4515-839c-14c298b123cb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-6418ae31-50a0-4515-839c-14c298b123cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:13.629074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:13.630123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:13.630931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:13.633285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 447/891] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:13.637942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ebe41-57d3-4a30-824a-3d77fb71d1c5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:13.786592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ebe41-57d3-4a30-824a-3d77fb71d1c5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:13.857677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:13.858664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.859136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.859785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.861135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:13.861556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:13.861686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb377c-35a3-4da7-9e94-bcbaa56df49b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.861886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb377c-35a3-4da7-9e94-bcbaa56df49b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.862410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb377c-35a3-4da7-9e94-bcbaa56df49b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.864180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:13.864678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 448/892] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:13.871466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113ed6-8020-487f-bd58-ad23f312172c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:13.872378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113ed6-8020-487f-bd58-ad23f312172c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:13.873168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113ed6-8020-487f-bd58-ad23f312172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:13.873798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 445/893] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:13.879422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:13.909342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c5113ed6-8020-487f-bd58-ad23f312172c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:13.912232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c5113ed6-8020-487f-bd58-ad23f312172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:13.932088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:14.001051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1f493-3245-4b13-99ce-37df6facac4f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:14.050765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:14.051403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:14.051682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:14.051954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:14.052806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:14.053112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:14.054534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:14.057167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 449/894] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:14.068474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 446/895] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:14.078575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5113ed6-8020-487f-bd58-ad23f312172c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:14.240300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:14.249897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5113ed6-8020-487f-bd58-ad23f312172c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:14.294849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:14.295487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:14.295768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:14.296038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:14.296806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] RBAC: Adding query filter params (interface=public, service_id=c4444a7f87e1408c9877a1dadd2ae29f, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:14.297116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:14.299374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:14.306086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 450/896] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Sep 13 12:18:14 2022] GET /identity/v3/endpoints?service_id=c4444a7f87e1408c9877a1dadd2ae29f&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:14.315775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:14.441087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:14.501852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349186-5da1-47cc-9311-6b303cec085c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:14.518619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:14.583382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccb0a1-4404-4245-a1ef-cc2104e0e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:14.584557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb0a1-4404-4245-a1ef-cc2104e0e098 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:14.585101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704119a-92de-478a-be52-e9ce4c29d349 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:14.585230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb0a1-4404-4245-a1ef-cc2104e0e098 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:14.585654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb0a1-4404-4245-a1ef-cc2104e0e098 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:14.586921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccb0a1-4404-4245-a1ef-cc2104e0e098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:14.589916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccb0a1-4404-4245-a1ef-cc2104e0e098 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:14.608677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 447/897] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:18:14 2022] GET /identity/v3/services => generated 1268 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:18:14.616201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedd531-7677-49aa-8f63-7f3cebcfe9a6 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:14.616798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedd531-7677-49aa-8f63-7f3cebcfe9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:14.617315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedd531-7677-49aa-8f63-7f3cebcfe9a6 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:14.620578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 448/898] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:14.629503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f7bd-3fab-4a7b-9d2f-3c48a3bcb76d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:14.629982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f7bd-3fab-4a7b-9d2f-3c48a3bcb76d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:14.630492 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f7bd-3fab-4a7b-9d2f-3c48a3bcb76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:14.638714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debc5d1-6549-4bb9-987e-231b08ab9079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:14.640045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debc5d1-6549-4bb9-987e-231b08ab9079 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:14.640557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debc5d1-6549-4bb9-987e-231b08ab9079 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:14.641032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debc5d1-6549-4bb9-987e-231b08ab9079 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:14.643090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debc5d1-6549-4bb9-987e-231b08ab9079 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:14.645894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debc5d1-6549-4bb9-987e-231b08ab9079 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:14.665145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0a60f7bd-3fab-4a7b-9d2f-3c48a3bcb76d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:14.667625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a60f7bd-3fab-4a7b-9d2f-3c48a3bcb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:14.685591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 451/899] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:18:14 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:14.840994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 449/900] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:15.285561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debc5d1-6549-4bb9-987e-231b08ab9079 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:15.307943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:15.403680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debc5d1-6549-4bb9-987e-231b08ab9079 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:15.443218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d00f45-0654-4340-bfee-9df6c9bb1dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:15.443881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d00f45-0654-4340-bfee-9df6c9bb1dfd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:15.444158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d00f45-0654-4340-bfee-9df6c9bb1dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:15.444456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d00f45-0654-4340-bfee-9df6c9bb1dfd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:15.456839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d00f45-0654-4340-bfee-9df6c9bb1dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-81d00f45-0654-4340-bfee-9df6c9bb1dfd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:15.462559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:15.464416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:15.466132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:15.472434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 452/901] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Sep 13 12:18:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:15.472865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f7bd-3fab-4a7b-9d2f-3c48a3bcb76d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:15.585316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:15.592710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f7bd-3fab-4a7b-9d2f-3c48a3bcb76d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:15.632664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:15.633292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:15.633561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:15.633827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:15.634501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:15.634795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:15.636209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:15.646482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 450/902] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Sep 13 12:18:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:15.652626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d00f45-0654-4340-bfee-9df6c9bb1dfd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:15.743796 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:15.771005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d00f45-0654-4340-bfee-9df6c9bb1dfd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:15.814305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1285d3-3909-428b-b464-dd99d7d3be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:15.814956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1285d3-3909-428b-b464-dd99d7d3be24 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:15.815236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1285d3-3909-428b-b464-dd99d7d3be24 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:15.815517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1285d3-3909-428b-b464-dd99d7d3be24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:15.828973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1285d3-3909-428b-b464-dd99d7d3be24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:15.830678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1285d3-3909-428b-b464-dd99d7d3be24 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-fa1285d3-3909-428b-b464-dd99d7d3be24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:15.848428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:15.851881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:15.855574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:15.855574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:15.855574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:15.855574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 453/903] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:15.856424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:15.936681 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dae51-877a-44ac-81c5-e11024e18dca None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:15.937128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dae51-877a-44ac-81c5-e11024e18dca None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:15.937355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dae51-877a-44ac-81c5-e11024e18dca None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:15.939327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 454/904] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:15.945111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529b955-4f5f-478b-b266-eab7d13a791b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:15.945538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529b955-4f5f-478b-b266-eab7d13a791b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:15.945908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529b955-4f5f-478b-b266-eab7d13a791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:15.966376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5529b955-4f5f-478b-b266-eab7d13a791b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:15.967876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5529b955-4f5f-478b-b266-eab7d13a791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:15.995671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7af14-8056-413d-ab8b-0d9fec59a28a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:16.042532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:16.043386 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:16.043757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:16.044096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:16.044875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:16.045244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:16.046993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:16.060584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 455/905] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:16.061391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 451/906] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:16.067439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529b955-4f5f-478b-b266-eab7d13a791b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:16.137487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:16.190129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529b955-4f5f-478b-b266-eab7d13a791b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:16.230783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:16.231449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:16.231733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:16.232009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:16.240965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:16.242464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:16.255846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:16.256916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:16.257955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 456/907] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:18:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:16.265145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:16.296790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:16.362337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:16.389798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0946f0-5292-4fda-9017-1d08b727cf1f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:16.440009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:16.441076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:16.441603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:16.442095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:16.443055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:16.443570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:16.445401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:16.477262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 452/908] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Sep 13 12:18:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:16.479088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:16.494776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea442a79-8ce1-4b77-a444-d17b1d10266b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:16.521271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:16.547746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:16.549385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:16.549669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:16.549942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:16.550560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:16.551984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:16.562025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:16.563337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:18:16.564540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:16.573343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 457/909] 10.222.0.55 () {56 vars in 1132 bytes} [Tue Sep 13 12:18:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:16.580578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:16.586899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:16.623633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f8674-95dc-458e-94ec-85c71361398f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:16.673487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45693-d653-48e9-9638-85a158e0017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:16.674133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45693-d653-48e9-9638-85a158e0017c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:16.674528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45693-d653-48e9-9638-85a158e0017c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:16.674863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45693-d653-48e9-9638-85a158e0017c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:16.712328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d9aaa-139c-4b27-a838-6555d3137c3b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:16.767148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:16.768146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:16.768767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:16.769301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:16.770241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:16.770799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:16.770906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a45693-d653-48e9-9638-85a158e0017c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:16.772541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a45693-d653-48e9-9638-85a158e0017c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:16.773018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:16.779639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 458/910] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:16.786525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:16.841736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:16.885906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:16.918744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a752e2c-47c2-4312-8404-4e327187c364 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:16.923298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 453/911] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:16 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:18:16.924973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45693-d653-48e9-9638-85a158e0017c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:16.977228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:16.978253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:16.978705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:16.979155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:16.980648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:16.980996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:16.982476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:16.990716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 459/912] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:16.997657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:17.074245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45693-d653-48e9-9638-85a158e0017c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:17.134837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01aeb38-45ec-45ca-909d-33adf7f8eb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:17.135919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aeb38-45ec-45ca-909d-33adf7f8eb8e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:17.136354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aeb38-45ec-45ca-909d-33adf7f8eb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:17.136827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aeb38-45ec-45ca-909d-33adf7f8eb8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:17.144088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee8dc3-f6e0-40c6-bf96-2ac545cda514 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:17.156484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aeb38-45ec-45ca-909d-33adf7f8eb8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:17.159029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:17.159988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aeb38-45ec-45ca-909d-33adf7f8eb8e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e01aeb38-45ec-45ca-909d-33adf7f8eb8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:17.188938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:17.189950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:17.190865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:17.190865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:17.190865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:17.191036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27fa2e-f101-4b90-8fe3-7e9b5a0a5a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:17.191036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27fa2e-f101-4b90-8fe3-7e9b5a0a5a95 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:17.191036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27fa2e-f101-4b90-8fe3-7e9b5a0a5a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:17.191036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27fa2e-f101-4b90-8fe3-7e9b5a0a5a95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:17.191300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27fa2e-f101-4b90-8fe3-7e9b5a0a5a95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:17.192533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27fa2e-f101-4b90-8fe3-7e9b5a0a5a95 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:17.196794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 454/913] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:17.199279 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e18ee-16e6-4849-b141-4179383d0763 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:17.199651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e18ee-16e6-4849-b141-4179383d0763 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:17.199888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e18ee-16e6-4849-b141-4179383d0763 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:17.201599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 455/914] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:17.202489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e18ee-16e6-4849-b141-4179383d0763 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:17.227358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 460/915] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:18:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:17.230218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0806815-33f1-42ec-8ac2-95a5be2bddc8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:17.230730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0806815-33f1-42ec-8ac2-95a5be2bddc8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:17.231193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0806815-33f1-42ec-8ac2-95a5be2bddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:17.254173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:17.263813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d0806815-33f1-42ec-8ac2-95a5be2bddc8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:17.266096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d0806815-33f1-42ec-8ac2-95a5be2bddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:17.389876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e18ee-16e6-4849-b141-4179383d0763 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:17.433061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 461/916] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:17.448124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:17.448797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:17.449081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:17.449357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:17.450046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:17.450418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:17.451946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:17.474636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 456/917] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:17.480512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0806815-33f1-42ec-8ac2-95a5be2bddc8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:17.613272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:17.620225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0806815-33f1-42ec-8ac2-95a5be2bddc8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:17.661816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:17.662487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:17.662767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:17.663041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:17.671192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:17.672845 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:17.686166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:17.687771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:17.690312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 462/918] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:17.696671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:17.864178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:17.902850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4901ef-a88c-4740-8c39-85e7eb19fa0b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:17.928055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:17.966471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86672161-60d6-4cd5-9cf1-823c97db7689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:17.967443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672161-60d6-4cd5-9cf1-823c97db7689 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:17.967913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672161-60d6-4cd5-9cf1-823c97db7689 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:17.968465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672161-60d6-4cd5-9cf1-823c97db7689 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:17.969693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672161-60d6-4cd5-9cf1-823c97db7689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:17.970207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672161-60d6-4cd5-9cf1-823c97db7689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:17.972852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672161-60d6-4cd5-9cf1-823c97db7689 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:17.991731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 457/919] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:17.997801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0641b4-f91c-42b9-965a-616c770eca6f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:17.998674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0641b4-f91c-42b9-965a-616c770eca6f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:17.999279 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0641b4-f91c-42b9-965a-616c770eca6f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:18.002071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 458/920] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:18.003596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0641b4-f91c-42b9-965a-616c770eca6f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:18.143912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4967acb-cc0d-4dde-bedd-120d08e10089 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:18.205542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0641b4-f91c-42b9-965a-616c770eca6f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:18.227067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304c9c3-1893-4c33-a0e7-5722592327cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:18.228196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304c9c3-1893-4c33-a0e7-5722592327cb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:18.228747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304c9c3-1893-4c33-a0e7-5722592327cb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:18.229235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304c9c3-1893-4c33-a0e7-5722592327cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:18.230343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304c9c3-1893-4c33-a0e7-5722592327cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:18.233032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304c9c3-1893-4c33-a0e7-5722592327cb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d304c9c3-1893-4c33-a0e7-5722592327cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:18.250528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:18.251771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:18:18.252837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:18.253855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 463/921] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:18.260773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a096c92-ad15-4974-8e14-44ab0c51751b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:18.260773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a096c92-ad15-4974-8e14-44ab0c51751b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:18.260773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a096c92-ad15-4974-8e14-44ab0c51751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:18.282907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:18.283869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:18.284429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:18.284893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:18.285970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] RBAC: Adding query filter params (role.id=d681a5a8fabe45de816073236bd6984b, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=f0a73e92e13c4e778dcdb2d089c64288) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:18.286496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:18.288718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9a096c92-ad15-4974-8e14-44ab0c51751b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:18.289345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:18.290661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9a096c92-ad15-4974-8e14-44ab0c51751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:18.308737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 459/922] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:18 2022] GET /identity/v3/role_assignments?user.id=f0a73e92e13c4e778dcdb2d089c64288&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=d681a5a8fabe45de816073236bd6984b => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:18.308737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:18.320111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:18.326121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:18.439752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 464/923] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:18.525925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891940f-ec6e-40bc-b13b-9c31d7c95f3e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:18.598952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:18.599952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:18.600447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:18.600928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:18.602078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:18.602595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:18.605214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:18.620986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 460/924] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:18.624975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a096c92-ad15-4974-8e14-44ab0c51751b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:18.830462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a096c92-ad15-4974-8e14-44ab0c51751b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:18.896431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:18.897717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:18.898740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:18.899424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:18.900861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:18.901633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:18.904549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:18.921004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 465/925] 10.222.0.55 () {56 vars in 1114 bytes} [Tue Sep 13 12:18:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:18.924739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:19.014112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:19.043594 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:19.073300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:19.139819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1de3fc-d983-464d-8efa-ceb03afdc02c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:19.211946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e57898-566a-40db-8f33-717529af5760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:19.212989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e57898-566a-40db-8f33-717529af5760 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:19.213643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e57898-566a-40db-8f33-717529af5760 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:19.214107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e57898-566a-40db-8f33-717529af5760 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:19.215316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e57898-566a-40db-8f33-717529af5760 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:19.218793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e57898-566a-40db-8f33-717529af5760 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:19.220844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f805cfb-4ddb-4925-a58d-a5f01634a8bd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:19.264452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 461/926] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:18:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:18:19.306591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:19.307660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:19.308135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:19.308635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:19.309631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:19.312082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:19.328335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:19.330368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:19.331636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 466/927] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:19.342768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e57898-566a-40db-8f33-717529af5760 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:19.545935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e57898-566a-40db-8f33-717529af5760 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:19.599565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:19.615826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:19.617172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:19.617172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:19.617643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:19.618856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:19.619370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:19.622037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:19.630554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 462/928] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:19.637826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:19.789858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:19.823687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27cae2-268b-49b5-8384-7ffcf005807a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:19.866500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadd8e-5c91-4bdc-ac81-6501e07d37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:19.867144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadd8e-5c91-4bdc-ac81-6501e07d37d7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:19.867425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadd8e-5c91-4bdc-ac81-6501e07d37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:19.867702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadd8e-5c91-4bdc-ac81-6501e07d37d7 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:19.868415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadd8e-5c91-4bdc-ac81-6501e07d37d7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:19.868742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadd8e-5c91-4bdc-ac81-6501e07d37d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:19.870360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadd8e-5c91-4bdc-ac81-6501e07d37d7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:19.876751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 467/929] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:19.886319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:19.914450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cd767-3256-4241-84ff-db6ff3d12c6b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:19.914767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cd767-3256-4241-84ff-db6ff3d12c6b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:19.915106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cd767-3256-4241-84ff-db6ff3d12c6b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:19.916755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 468/930] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:19.923067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21f6c-6cad-4685-b596-cda8c81f2ee5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:19.923328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21f6c-6cad-4685-b596-cda8c81f2ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:19.923720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21f6c-6cad-4685-b596-cda8c81f2ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:19.945937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-89b21f6c-6cad-4685-b596-cda8c81f2ee5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:19.947208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-89b21f6c-6cad-4685-b596-cda8c81f2ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:20.034570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 469/931] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:20.089919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cbdb9-c6da-4fae-b546-50d3e4704023 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:20.133124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:20.133819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:20.134215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:20.134496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:20.135243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] RBAC: Adding query filter params (interface=public, service_id=ec665355bc81409cbc82675cdabf3e2f, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:20.135567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:20.137059 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:20.147110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 463/932] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Sep 13 12:18:19 2022] GET /identity/v3/endpoints?service_id=ec665355bc81409cbc82675cdabf3e2f&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:20.156221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21f6c-6cad-4685-b596-cda8c81f2ee5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:20.289120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:20.357025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21f6c-6cad-4685-b596-cda8c81f2ee5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:20.365358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:20.408812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52c88-8c39-4428-9540-18b9bf1e64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:20.409803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52c88-8c39-4428-9540-18b9bf1e64b2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:20.410098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52c88-8c39-4428-9540-18b9bf1e64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:20.410379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c52c88-8c39-4428-9540-18b9bf1e64b2 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:20.411534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c52c88-8c39-4428-9540-18b9bf1e64b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:20.413054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c52c88-8c39-4428-9540-18b9bf1e64b2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:20.421996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 470/933] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:18:20 2022] GET /identity/v3/services => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:18:20.498143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:20.597557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bff53-8fe7-4a30-aa5f-e10f060cffe2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:20.672830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:20.673971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:20.674463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:20.674947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:20.676057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:20.678831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:20.696909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:20.698679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:20.700934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 464/934] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:20.709051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52c88-8c39-4428-9540-18b9bf1e64b2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:20.920440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c52c88-8c39-4428-9540-18b9bf1e64b2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:20.981693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:20.992380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e58c27-55ef-4339-be0d-ee24de51af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:20.994094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58c27-55ef-4339-be0d-ee24de51af2b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:20.994872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58c27-55ef-4339-be0d-ee24de51af2b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:20.995647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58c27-55ef-4339-be0d-ee24de51af2b None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:20.997120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e58c27-55ef-4339-be0d-ee24de51af2b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:20.997990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e58c27-55ef-4339-be0d-ee24de51af2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:21.001264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e58c27-55ef-4339-be0d-ee24de51af2b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:21.011806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 471/935] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:18:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:21.018212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:21.230050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2e69b-aa26-4c0a-8ccf-56fa2f7b1546 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:21.272723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:21.303137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bc00b-0116-4066-9e09-ba662a9d3c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:21.304229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bc00b-0116-4066-9e09-ba662a9d3c1a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:21.304759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bc00b-0116-4066-9e09-ba662a9d3c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:21.305237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bc00b-0116-4066-9e09-ba662a9d3c1a None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:21.306499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bc00b-0116-4066-9e09-ba662a9d3c1a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:21.307017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bc00b-0116-4066-9e09-ba662a9d3c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:21.309748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bc00b-0116-4066-9e09-ba662a9d3c1a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:21.319835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 465/936] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:18:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:21.490770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712165a-da0c-41a4-bc26-faf67a2e3c33 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:21.491039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712165a-da0c-41a4-bc26-faf67a2e3c33 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:21.491421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712165a-da0c-41a4-bc26-faf67a2e3c33 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:21.493146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 472/937] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:21.502187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e14b0-4774-42fb-857c-8d1c925f2958 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:21.502627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e14b0-4774-42fb-857c-8d1c925f2958 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:21.503071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e14b0-4774-42fb-857c-8d1c925f2958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:21.526095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7d9e14b0-4774-42fb-857c-8d1c925f2958 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:21.527290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7d9e14b0-4774-42fb-857c-8d1c925f2958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:21.672759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 466/938] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:22.169015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712165a-da0c-41a4-bc26-faf67a2e3c33 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:22.345454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712165a-da0c-41a4-bc26-faf67a2e3c33 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:22.386553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38b0ae-0710-4f44-9c44-0b65502e46cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:22.387839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b0ae-0710-4f44-9c44-0b65502e46cf None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:22.388110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b0ae-0710-4f44-9c44-0b65502e46cf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:22.388378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b0ae-0710-4f44-9c44-0b65502e46cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:22.401623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38b0ae-0710-4f44-9c44-0b65502e46cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ad38b0ae-0710-4f44-9c44-0b65502e46cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:22.406926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:22.408786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:22.410484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 473/939] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Sep 13 12:18:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:22.418724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e14b0-4774-42fb-857c-8d1c925f2958 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:22.645300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e14b0-4774-42fb-857c-8d1c925f2958 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:22.677648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:22.723101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed514f87-6f3a-4b3a-a24f-5b5a307cb47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:22.724712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514f87-6f3a-4b3a-a24f-5b5a307cb47a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:22.725521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514f87-6f3a-4b3a-a24f-5b5a307cb47a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:22.726289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514f87-6f3a-4b3a-a24f-5b5a307cb47a None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:22.727836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed514f87-6f3a-4b3a-a24f-5b5a307cb47a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:22.728761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed514f87-6f3a-4b3a-a24f-5b5a307cb47a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:22.731736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed514f87-6f3a-4b3a-a24f-5b5a307cb47a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:22.751952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 467/940] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Sep 13 12:18:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:22.762784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38b0ae-0710-4f44-9c44-0b65502e46cf None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:22.877447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:22.884998 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eaabd-c0cf-4e87-ab14-615681a2d289 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:22.885500 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eaabd-c0cf-4e87-ab14-615681a2d289 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:22.885995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eaabd-c0cf-4e87-ab14-615681a2d289 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:22.889078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 468/941] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:22.896431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6941-25ab-4a9e-96dc-b3f8d7d516d1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:22.896692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6941-25ab-4a9e-96dc-b3f8d7d516d1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:22.897065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6941-25ab-4a9e-96dc-b3f8d7d516d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:22.924379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7c7c6941-25ab-4a9e-96dc-b3f8d7d516d1 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:22.928753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7c7c6941-25ab-4a9e-96dc-b3f8d7d516d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:22.979368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38b0ae-0710-4f44-9c44-0b65502e46cf None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:23.019770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 469/942] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:23.051926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:23.053400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:23.054070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:23.054798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:23.076468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:23.079705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:23.109384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:23.111183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:23.112910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:23.112910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:23.112910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:23.120258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 474/943] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:23.127252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c6941-25ab-4a9e-96dc-b3f8d7d516d1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:23.288229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c6941-25ab-4a9e-96dc-b3f8d7d516d1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:23.297033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:23.351466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:23.356648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:23.358172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:23.358930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:23.359689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:23.361370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:23.362206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:23.365521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:23.389015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 470/944] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:23.395268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:23.541827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085545-7082-41d4-951a-c6713ed0a2b0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:23.556406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:23.597816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04700b02-f627-4286-b9dc-77e21fb17eb4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:23.601684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:23.602554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:23.602837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:23.603115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:23.603802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:23.606497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:23.609279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING keystone.server.flask.common [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 12:18:23.652958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.sql.core [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:18:23.652958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 12:18:23.652958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [parameters: {'id': 'c404f7049cf94680adbf79c6d25d3fc9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 12:18:23.652958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81432) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 12:18:23.678161 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:23.679956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:23.680846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:23.681704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c404f7049cf94680adbf79c6d25d3fc9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c404f7049cf94680adbf79c6d25d3fc9. Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:18:23.686895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application result.read() Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 12:18:23.688590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application yield resource Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise self.value Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application session.commit() Sep 13 12:18:23.690520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self.session.flush() Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application compat.raise_( Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 12:18:23.692267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 12:18:23.696319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application result.read() Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:18:23.698953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [parameters: {'id': 'c404f7049cf94680adbf79c6d25d3fc9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:23.705602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:23.708809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c404f7049cf94680adbf79c6d25d3fc9. Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 475/945] 10.222.0.55 () {60 vars in 1140 bytes} [Tue Sep 13 12:18:23 2022] POST /identity/v3/projects => generated 262 bytes in 346 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:23.713407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:23.723863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:23.727289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:23.748416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:23.750239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:23.753890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:23.758766 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 471/946] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:18:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:23.768632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:23.827032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:23.925851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6270ab-40a5-4011-b3a8-af16077b0e47 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:23.969177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af7d96-ced3-4e4f-8a0a-8840b8cb54bd None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:23.993416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22335f9-90b7-4e4b-878c-f5ddb4bb6d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:23.994503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22335f9-90b7-4e4b-878c-f5ddb4bb6d95 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:23.994999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22335f9-90b7-4e4b-878c-f5ddb4bb6d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:23.995486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22335f9-90b7-4e4b-878c-f5ddb4bb6d95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.009144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22335f9-90b7-4e4b-878c-f5ddb4bb6d95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:24.012228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22335f9-90b7-4e4b-878c-f5ddb4bb6d95 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c22335f9-90b7-4e4b-878c-f5ddb4bb6d95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:24.037279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:24.038273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:24.039175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:24.039175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:24.039175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:24.039175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:24.039175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:24.039175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:24.039175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:24.039175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:24.040757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 476/947] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:24.042988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e232e47-02b0-440c-a05e-178d2a2fc018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:24.043149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef9d4-d55a-44f6-b38e-34b0e85aeebe None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.043603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef9d4-d55a-44f6-b38e-34b0e85aeebe None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.044088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef9d4-d55a-44f6-b38e-34b0e85aeebe None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.044584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232e47-02b0-440c-a05e-178d2a2fc018 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.045301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232e47-02b0-440c-a05e-178d2a2fc018 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.046034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232e47-02b0-440c-a05e-178d2a2fc018 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.048110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e232e47-02b0-440c-a05e-178d2a2fc018 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:24.049011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e232e47-02b0-440c-a05e-178d2a2fc018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:24.051892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e232e47-02b0-440c-a05e-178d2a2fc018 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:24.055275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 477/948] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:24.055275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef9d4-d55a-44f6-b38e-34b0e85aeebe None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:24.082494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 472/949] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Sep 13 12:18:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:24.084422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7acc6-dec7-4aac-b8d5-8be5e81a1eda None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.084905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7acc6-dec7-4aac-b8d5-8be5e81a1eda None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.085370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7acc6-dec7-4aac-b8d5-8be5e81a1eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.107989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:24.111476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a8b7acc6-dec7-4aac-b8d5-8be5e81a1eda None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:24.113098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a8b7acc6-dec7-4aac-b8d5-8be5e81a1eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:24.217800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 473/950] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:24.221339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7acc6-dec7-4aac-b8d5-8be5e81a1eda None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:24.256559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:24.263646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef9d4-d55a-44f6-b38e-34b0e85aeebe None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:24.323779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad07a4-dd57-4e2b-a8c9-648bd6bbbe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:24.325271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad07a4-dd57-4e2b-a8c9-648bd6bbbe41 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.326043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad07a4-dd57-4e2b-a8c9-648bd6bbbe41 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.326833 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad07a4-dd57-4e2b-a8c9-648bd6bbbe41 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.328851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad07a4-dd57-4e2b-a8c9-648bd6bbbe41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:24.330125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad07a4-dd57-4e2b-a8c9-648bd6bbbe41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:24.333159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad07a4-dd57-4e2b-a8c9-648bd6bbbe41 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:24.372726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 478/951] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:18:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:24.372726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83766f31-725e-4bf8-b8fc-52eb66c9dd7e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.372726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83766f31-725e-4bf8-b8fc-52eb66c9dd7e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.372726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83766f31-725e-4bf8-b8fc-52eb66c9dd7e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.375804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 479/952] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:24.383620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7acc6-dec7-4aac-b8d5-8be5e81a1eda None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:24.395024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24febfa9-481f-4b66-8feb-206d803c0870 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.395935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24febfa9-481f-4b66-8feb-206d803c0870 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.396732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24febfa9-481f-4b66-8feb-206d803c0870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.431465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-24febfa9-481f-4b66-8feb-206d803c0870 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:24.432980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:24.433670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.433949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.434218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.436214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-24febfa9-481f-4b66-8feb-206d803c0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:24.447773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:24.449454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:24.474270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:24.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:24.478770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:24.478770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:24.478770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:24.478770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 474/953] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:24.481753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:24.588136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 480/954] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:24.593330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:24.639601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942e201-2409-44a9-a2eb-e33e4808fa79 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:24.683573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:24.684217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.684708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.684918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.685587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:24.685874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:24.687312 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:24.695814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24febfa9-481f-4b66-8feb-206d803c0870 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:24.701717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 475/955] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:24.708755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:24.733289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:24.859188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d241bc6-1580-4df5-9230-500c14f30958 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:24.898216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:24.905893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24febfa9-481f-4b66-8feb-206d803c0870 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:24.925491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:24.926172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.926454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.926728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.940955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:24.943035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:24.963697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:24.964729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:24.965637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:24.965637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:24.965637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:24.965637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:24.965637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:24.965637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:24.965637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:24.965637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:24.971368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:24.972501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:24.972991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:24.973467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:24.974284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:24.982524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:24.983402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 476/956] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:24.984643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:25.014140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:25.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:25.016753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:25.024880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 481/957] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:25.034239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:25.152862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:25.160009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba70e0-6187-4934-8a2b-249531a2ae2a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:25.186711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f665b9f-ae8b-42ec-869b-0d05fff0a2fa None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:25.211326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:25.211945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:25.212222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:25.212527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:25.213996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:25.213996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:25.215039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:25.234616 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 477/958] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:25.235688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:25.244375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:25.245241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:25.245584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:25.245830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:25.246466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:25.246773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:25.248217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:25.257551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 482/959] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:25.258066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:25.323340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:25.406502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180dac-fa65-4d14-8823-1b52c8d1b576 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:25.417822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49fae4-874d-4214-8354-717997e5a080 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:25.464187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501d0c4-19fd-4814-b388-b46ca76daf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:25.464852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501d0c4-19fd-4814-b388-b46ca76daf7d None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:25.465130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501d0c4-19fd-4814-b388-b46ca76daf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:25.465615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501d0c4-19fd-4814-b388-b46ca76daf7d None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:25.466299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501d0c4-19fd-4814-b388-b46ca76daf7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:25.468229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501d0c4-19fd-4814-b388-b46ca76daf7d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:25.475274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbbe5d-0168-4c59-834b-f219e748961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:25.476635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbbe5d-0168-4c59-834b-f219e748961d None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:25.477148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbbe5d-0168-4c59-834b-f219e748961d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:25.477775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbbe5d-0168-4c59-834b-f219e748961d None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/f0a73e92e13c4e778dcdb2d089c64288/roles/d681a5a8fabe45de816073236bd6984b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:25.480900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbbe5d-0168-4c59-834b-f219e748961d None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=f0a73e92e13c4e778dcdb2d089c64288, role_id=d681a5a8fabe45de816073236bd6984b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:25.482296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbbe5d-0168-4c59-834b-f219e748961d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:25.491757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 478/960] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:18:25 2022] POST /identity/v3/services => generated 242 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:25.492960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501d0c4-19fd-4814-b388-b46ca76daf7d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:25.513293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 483/961] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:18:25 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/f0a73e92e13c4e778dcdb2d089c64288/roles/d681a5a8fabe45de816073236bd6984b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:18:25.702370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501d0c4-19fd-4814-b388-b46ca76daf7d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:25.706475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:25.775564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505c56f-58e2-46ce-8855-5c6191b5aaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:25.777158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c56f-58e2-46ce-8855-5c6191b5aaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:25.777881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c56f-58e2-46ce-8855-5c6191b5aaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:25.778540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c56f-58e2-46ce-8855-5c6191b5aaf0 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:25.779844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c56f-58e2-46ce-8855-5c6191b5aaf0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:25.780642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c56f-58e2-46ce-8855-5c6191b5aaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:25.783489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c56f-58e2-46ce-8855-5c6191b5aaf0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:25.793995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 479/962] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:25.802710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbbe5d-0168-4c59-834b-f219e748961d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:25.807585 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:25.999606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbbe5d-0168-4c59-834b-f219e748961d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:26.042324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec68ba-7310-4a35-b3fd-593cf8b28289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:26.048468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec68ba-7310-4a35-b3fd-593cf8b28289 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:26.048468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec68ba-7310-4a35-b3fd-593cf8b28289 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:26.048468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec68ba-7310-4a35-b3fd-593cf8b28289 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:26.048468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec68ba-7310-4a35-b3fd-593cf8b28289 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:26.048468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec68ba-7310-4a35-b3fd-593cf8b28289 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:26.088217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 484/963] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:18:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:18:27.392823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843540bf-8f9d-41dc-80f2-d85b65c8c873 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:27.393909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843540bf-8f9d-41dc-80f2-d85b65c8c873 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:27.394405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843540bf-8f9d-41dc-80f2-d85b65c8c873 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:27.396421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 480/964] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:27.403243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c037a-2da2-4b40-8e00-0fec4afbdbf2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:27.404297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c037a-2da2-4b40-8e00-0fec4afbdbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:27.404839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c037a-2da2-4b40-8e00-0fec4afbdbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:27.427449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-181c037a-2da2-4b40-8e00-0fec4afbdbf2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:27.429375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-181c037a-2da2-4b40-8e00-0fec4afbdbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:27.505277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:27.557498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 485/965] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:28.035013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599ccb1-5f8b-41b1-9567-13bd6c198c5f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:28.035460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599ccb1-5f8b-41b1-9567-13bd6c198c5f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:28.035888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599ccb1-5f8b-41b1-9567-13bd6c198c5f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:28.038715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 481/966] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:28.046985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873378-772a-49e4-b4c9-3787c1ce1ad8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:28.047853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873378-772a-49e4-b4c9-3787c1ce1ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:28.047853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873378-772a-49e4-b4c9-3787c1ce1ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:28.063198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599ccb1-5f8b-41b1-9567-13bd6c198c5f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:28.068791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bd873378-772a-49e4-b4c9-3787c1ce1ad8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:28.070086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bd873378-772a-49e4-b4c9-3787c1ce1ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:28.192575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 486/967] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:28.198568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599ccb1-5f8b-41b1-9567-13bd6c198c5f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:28.242815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:28.243448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:28.243759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:28.244014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:28.244700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:28.246198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:28.249038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING keystone.server.flask.common [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 12:18:28.264697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.sql.core [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:18:28.264697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 12:18:28.264697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [parameters: {'user_id': '0e8ea788e4ce4da2ace5bfbb6fa6da36', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 12:18:28.264697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81433) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Sep 13 12:18:28.273933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:18:28.275672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application yield resource Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise self.value Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application session.commit() Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 12:18:28.277568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.flush() Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application compat.raise_( Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 12:18:28.279344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:18:28.282742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:18:28.289003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [parameters: {'user_id': '0e8ea788e4ce4da2ace5bfbb6fa6da36', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:28.289984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 12:18:28.290865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 12:18:28.292643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 12:18:28.292643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 12:18:28.292643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 12:18:28.292643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 12:18:28.292643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 12:18:28.292643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:28.292643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 482/968] 10.222.0.55 () {60 vars in 1131 bytes} [Tue Sep 13 12:18:28 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:28.293250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd873378-772a-49e4-b4c9-3787c1ce1ad8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:28.432154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd873378-772a-49e4-b4c9-3787c1ce1ad8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:28.454353 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:28.491759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:28.493432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:28.494233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:28.494964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:28.511468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:28.515051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:28.541162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:28.542922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:18:28.544827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:28.548891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 487/969] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:18:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:28.557903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:28.601179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:28.714631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd2ef-855d-4229-b6ba-8979045500e6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:28.757652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb188344-f39d-437c-b513-d2a468d9705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:28.758539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188344-f39d-437c-b513-d2a468d9705c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:28.758960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188344-f39d-437c-b513-d2a468d9705c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:28.759403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188344-f39d-437c-b513-d2a468d9705c None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:28.760293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb188344-f39d-437c-b513-d2a468d9705c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:28.761025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb188344-f39d-437c-b513-d2a468d9705c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:28.762922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb188344-f39d-437c-b513-d2a468d9705c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:28.777893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:28.832454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 483/970] 10.222.0.55 () {56 vars in 1101 bytes} [Tue Sep 13 12:18:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:28.933649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0965d-42e6-4509-bf1a-ecd6b835fdf8 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:28.934507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0965d-42e6-4509-bf1a-ecd6b835fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:28.934991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0965d-42e6-4509-bf1a-ecd6b835fdf8 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:28.940446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 484/971] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:28.944189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad1a9-1ee5-40ad-97d4-8882919ba7ba None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:28.944796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad1a9-1ee5-40ad-97d4-8882919ba7ba None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:28.945262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad1a9-1ee5-40ad-97d4-8882919ba7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:28.966510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-487ad1a9-1ee5-40ad-97d4-8882919ba7ba None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:28.968515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-487ad1a9-1ee5-40ad-97d4-8882919ba7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:28.988913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da3378-95d6-4f65-869c-7afac5d150e6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:29.065293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 485/972] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:29.073647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c367e-1abd-4f97-a454-58dfc7954e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:29.074774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c367e-1abd-4f97-a454-58dfc7954e34 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:29.075282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c367e-1abd-4f97-a454-58dfc7954e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:29.075756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c367e-1abd-4f97-a454-58dfc7954e34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:29.090564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c367e-1abd-4f97-a454-58dfc7954e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ce8c367e-1abd-4f97-a454-58dfc7954e34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:29.096433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:29.098376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:29.100091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 488/973] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Sep 13 12:18:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:29.106662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ad1a9-1ee5-40ad-97d4-8882919ba7ba None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:29.132091 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:29.270431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ad1a9-1ee5-40ad-97d4-8882919ba7ba None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:29.333519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:29.334323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:29.334792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:29.335213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:29.336030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:29.336340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:29.337843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:29.347901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 486/974] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Sep 13 12:18:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:29.354209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:29.354534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c367e-1abd-4f97-a454-58dfc7954e34 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:29.411104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:29.461277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:29.492798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44cdae-f5e8-4eed-b7dd-6238e09005fe None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:29.511112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c367e-1abd-4f97-a454-58dfc7954e34 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:29.545539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c1925-ebb0-4f07-bc8c-1949e7c37a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:29.546191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1925-ebb0-4f07-bc8c-1949e7c37a3c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:29.546471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1925-ebb0-4f07-bc8c-1949e7c37a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:29.546737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1925-ebb0-4f07-bc8c-1949e7c37a3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:29.547413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c1925-ebb0-4f07-bc8c-1949e7c37a3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:29.549112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c1925-ebb0-4f07-bc8c-1949e7c37a3c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:29.560224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937493c-d765-4963-9d17-3ce64859fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:29.560919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937493c-d765-4963-9d17-3ce64859fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:29.561197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937493c-d765-4963-9d17-3ce64859fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:29.561473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937493c-d765-4963-9d17-3ce64859fbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-716c1925-ebb0-4f07-bc8c-1949e7c37a3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:29.569461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:29.572035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:29.573781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 487/975] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:29.575340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018387d0-6794-4584-9d32-599c52f6ec5f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:29.575340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018387d0-6794-4584-9d32-599c52f6ec5f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:29.575340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018387d0-6794-4584-9d32-599c52f6ec5f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:29.576959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 488/976] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:29.583184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018387d0-6794-4584-9d32-599c52f6ec5f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:29.584640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937493c-d765-4963-9d17-3ce64859fbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:29.586435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937493c-d765-4963-9d17-3ce64859fbd8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e937493c-d765-4963-9d17-3ce64859fbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:29.605688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:29.607542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:29.610654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:29.610654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:29.610654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:29.610654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 489/977] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:29.610654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280884-0df2-47d7-bf63-979e077afb1e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:29.610654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280884-0df2-47d7-bf63-979e077afb1e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:29.610654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280884-0df2-47d7-bf63-979e077afb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:29.628677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6d280884-0df2-47d7-bf63-979e077afb1e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:29.629924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6d280884-0df2-47d7-bf63-979e077afb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:29.743306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 490/978] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:29.743306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d280884-0df2-47d7-bf63-979e077afb1e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:29.743759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018387d0-6794-4584-9d32-599c52f6ec5f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:29.773673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:29.805586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:29.807079 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:29.807581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:29.808044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:29.809254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:29.809856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:29.812547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:29.822783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 489/979] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:18:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:29.830417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:29.850611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:29.918689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d280884-0df2-47d7-bf63-979e077afb1e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:29.982247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:29.982945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:29.983233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:29.983504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:29.984177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:29.984518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:29.986633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:30.005573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 491/980] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:30.007746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:30.012655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab4047-ed00-426f-97ba-7232e55fbb61 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.080801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:30.081957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:30.082522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:30.082993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:30.084158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:30.084726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:30.087330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:30.096768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 490/981] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:18:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:30.098291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:30.106259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:30.148829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74efff4-1d8b-4441-8d90-516d7657bbca None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.178723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:30.192590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:30.193381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:30.193770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:30.194142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:30.203588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:30.205135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:30.218107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:30.219404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 492/982] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:18:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:30.221467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:30.231890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf733f7-19e3-4fc5-8cfb-10efcd49c7fe None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.270797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:30.271464 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:30.271742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:30.272012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:30.272638 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:30.274403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:30.283953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:30.285812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:30.287396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 491/983] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:30.290115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:30.382810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e749-5217-4664-a8ea-300429bea0fe None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.438832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:30.439443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:30.439614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9a55c-5560-4210-bcf2-1afa8e902852 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.439836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:30.440181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:30.441039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] RBAC: Adding query filter params (interface=public, service_id=469cd7bb530f464a844d22ec79349f8f, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:30.441419 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:30.443446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:30.446712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:30.450974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 493/984] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Sep 13 12:18:30 2022] GET /identity/v3/endpoints?service_id=469cd7bb530f464a844d22ec79349f8f&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:30.452800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:30.490843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:30.491602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:30.491950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:30.492278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:30.493223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:30.493581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:30.495726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:30.498398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:30.527694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 492/985] 10.222.0.55 () {56 vars in 1149 bytes} [Tue Sep 13 12:18:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:30.529142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:30.621961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d496-1482-4980-9c0a-acb607e5e493 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.666876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:30.667527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:30.667803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:30.668076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:30.668797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:30.669109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:30.670581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:30.676342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 494/986] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:30.677270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:30.684718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd6e17-23dc-49d1-be1b-dd810a4195c9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.735487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462d80-e1d7-4a76-92db-3851020dec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:30.736374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462d80-e1d7-4a76-92db-3851020dec62 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:30.736884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462d80-e1d7-4a76-92db-3851020dec62 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:30.737359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462d80-e1d7-4a76-92db-3851020dec62 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:30.738614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b462d80-e1d7-4a76-92db-3851020dec62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:30.741494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b462d80-e1d7-4a76-92db-3851020dec62 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:30.751931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:30.754675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 493/987] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:18:30 2022] GET /identity/v3/services => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:18:30.756193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462d80-e1d7-4a76-92db-3851020dec62 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:30.824432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6cddc-bedb-4668-91ed-1ece8b049c83 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.859169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:30.883575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8417d-0b66-4381-9f04-5ebae499ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:30.884521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8417d-0b66-4381-9f04-5ebae499ed14 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:30.885122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8417d-0b66-4381-9f04-5ebae499ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:30.885474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8417d-0b66-4381-9f04-5ebae499ed14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:30.943286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462d80-e1d7-4a76-92db-3851020dec62 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:30.987002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8417d-0b66-4381-9f04-5ebae499ed14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:30.988984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8417d-0b66-4381-9f04-5ebae499ed14 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:31.005178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:31.006141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:31.006566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:31.006991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:31.007981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:31.008542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:31.010761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:31.018991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 494/988] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:31.026256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:31.098565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:31.172945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 495/989] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:30 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:18:31.180181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8417d-0b66-4381-9f04-5ebae499ed14 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:31.193838 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a3a2d-8eb3-4ec1-9521-6c64a3bfe1f8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:31.223629 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:31.245829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:31.246554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:31.246961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:31.247364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:31.248286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] RBAC: Adding query filter params (interface=admin, service_id=ec665355bc81409cbc82675cdabf3e2f, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:31.248755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:31.250378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:31.257540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 495/990] 10.222.0.55 () {56 vars in 1249 bytes} [Tue Sep 13 12:18:31 2022] GET /identity/v3/endpoints?service_id=ec665355bc81409cbc82675cdabf3e2f&interface=admin®ion_id=RegionOne => generated 193 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:31.264954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:31.344549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8417d-0b66-4381-9f04-5ebae499ed14 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:31.411134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:31.412271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:31.412787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:31.413142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:31.432090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:31.434692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:31.454046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadcdbe-60b3-473b-b4b5-eb8719f050f0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:31.461148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:31.463094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:31.464816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:31.464816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:31.464816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:31.471052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 496/991] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:31.472580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:31.503283 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:31.526894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6272-1c3a-4b76-a68d-312a49ebf6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:31.528204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6272-1c3a-4b76-a68d-312a49ebf6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:31.528854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6272-1c3a-4b76-a68d-312a49ebf6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:31.529497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6272-1c3a-4b76-a68d-312a49ebf6a4 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:31.530740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d6272-1c3a-4b76-a68d-312a49ebf6a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:31.532962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d6272-1c3a-4b76-a68d-312a49ebf6a4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:31.545004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 496/992] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:18:31 2022] GET /identity/v3/services => generated 1727 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:18:31.641135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ccdab-c7ef-4c5f-87ae-17269dc12883 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:31.690947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:31.691773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:31.692184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:31.692903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:31.693798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:31.694296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:31.695929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:31.716727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 497/993] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:31.718267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6272-1c3a-4b76-a68d-312a49ebf6a4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:31.787886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:31.893147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6272-1c3a-4b76-a68d-312a49ebf6a4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:31.960272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:31.961398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:31.961860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:31.962314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:31.975355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:31.977944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:31.998918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:31.999932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:32.001381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:32.001381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:32.001381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:32.001381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:32.001381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:32.001381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:32.001381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:32.001381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:32.001837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 497/994] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:32.008320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:32.111172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:32.143691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade9bf-0a2f-4b9a-b2dc-c6507eca22d2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:32.188683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95839c82-6347-44a4-a6b0-c2731d710531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:32.189553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839c82-6347-44a4-a6b0-c2731d710531 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:32.189982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839c82-6347-44a4-a6b0-c2731d710531 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:32.190291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839c82-6347-44a4-a6b0-c2731d710531 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:32.191112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95839c82-6347-44a4-a6b0-c2731d710531 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:32.191520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95839c82-6347-44a4-a6b0-c2731d710531 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:32.193125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95839c82-6347-44a4-a6b0-c2731d710531 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:32.212545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 498/995] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:32.215007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:32.412972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae2b90-c6ca-43d5-8c9c-713989bb0812 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:32.430668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:32.487465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312f2e0-7e7b-4ee1-9aab-be6a64b01676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:32.488654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f2e0-7e7b-4ee1-9aab-be6a64b01676 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:32.489209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f2e0-7e7b-4ee1-9aab-be6a64b01676 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:32.489767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f2e0-7e7b-4ee1-9aab-be6a64b01676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:32.491225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312f2e0-7e7b-4ee1-9aab-be6a64b01676 None admin] RBAC: Adding query filter params (role.id=d681a5a8fabe45de816073236bd6984b, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=f0a73e92e13c4e778dcdb2d089c64288) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:32.491862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312f2e0-7e7b-4ee1-9aab-be6a64b01676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:32.494783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312f2e0-7e7b-4ee1-9aab-be6a64b01676 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:32.512756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 498/996] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:32 2022] GET /identity/v3/role_assignments?user.id=f0a73e92e13c4e778dcdb2d089c64288&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=d681a5a8fabe45de816073236bd6984b => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:33.358132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e706-006e-468d-95d3-7e15bb117b05 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:33.358957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e706-006e-468d-95d3-7e15bb117b05 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:33.359135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e706-006e-468d-95d3-7e15bb117b05 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:33.361070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 499/997] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:33.367304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc867-ab92-4efe-92d5-1d8773e6f2c3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:33.368093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc867-ab92-4efe-92d5-1d8773e6f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:33.368264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc867-ab92-4efe-92d5-1d8773e6f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:33.390228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-362dc867-ab92-4efe-92d5-1d8773e6f2c3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:33.391739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-362dc867-ab92-4efe-92d5-1d8773e6f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:33.484610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 499/998] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:33.751331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e706-006e-468d-95d3-7e15bb117b05 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:33.918776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e706-006e-468d-95d3-7e15bb117b05 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:33.962989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:33.964007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:33.964506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:33.964971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:33.966028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:33.968944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:33.974499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:33.990335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:33.992316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:18:33.994004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:33.995443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 500/999] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:34.004470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc867-ab92-4efe-92d5-1d8773e6f2c3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:34.229613 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc867-ab92-4efe-92d5-1d8773e6f2c3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:34.233278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:34.303861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:34.304851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:34.305332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:34.305809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:34.307010 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:34.307545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:34.310334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:34.321104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 500/1000] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:18:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:34.330184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:34.550846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdc0e1-59c4-41d7-9724-92064319cc20 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:34.628058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16921e-f8b6-41be-a234-52bd8f4ea0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:34.628749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16921e-f8b6-41be-a234-52bd8f4ea0eb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:34.629023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16921e-f8b6-41be-a234-52bd8f4ea0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:34.629296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16921e-f8b6-41be-a234-52bd8f4ea0eb None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:34.629958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16921e-f8b6-41be-a234-52bd8f4ea0eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:34.630260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16921e-f8b6-41be-a234-52bd8f4ea0eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:34.631719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16921e-f8b6-41be-a234-52bd8f4ea0eb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:34.638266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 501/1001] 10.222.0.55 () {56 vars in 1112 bytes} [Tue Sep 13 12:18:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:34.645159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:34.741994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078bbd0-4f5b-4779-ba75-b82cb60fd8b4 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:34.742507 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078bbd0-4f5b-4779-ba75-b82cb60fd8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:34.742909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078bbd0-4f5b-4779-ba75-b82cb60fd8b4 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:34.745189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 502/1002] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:34.754231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e71fd5-079a-4913-a26b-40769f3b23ec None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:34.754671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e71fd5-079a-4913-a26b-40769f3b23ec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:34.755127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e71fd5-079a-4913-a26b-40769f3b23ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:34.785324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-52e71fd5-079a-4913-a26b-40769f3b23ec None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:34.787336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-52e71fd5-079a-4913-a26b-40769f3b23ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:34.842341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26df0-98a2-48d6-ac59-188bfb21a814 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:34.877422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:34.890242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 503/1003] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:34.895214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec516-a490-47d5-bc03-ea00308944fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:34.896251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec516-a490-47d5-bc03-ea00308944fb None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:34.896775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec516-a490-47d5-bc03-ea00308944fb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:34.897272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec516-a490-47d5-bc03-ea00308944fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:34.898867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ec516-a490-47d5-bc03-ea00308944fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:34.901900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ec516-a490-47d5-bc03-ea00308944fb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:34.908010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e0e3-5316-415d-985e-1d5234f220aa None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:34.908533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e0e3-5316-415d-985e-1d5234f220aa None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:34.909020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e0e3-5316-415d-985e-1d5234f220aa None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:34.912664 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 504/1004] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:34.918998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8853-91ab-4d80-8020-4fcaf40cd039 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:34.920202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8853-91ab-4d80-8020-4fcaf40cd039 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:34.921025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8853-91ab-4d80-8020-4fcaf40cd039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:34.934711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 501/1005] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:18:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:18:34.956449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4f6c8853-91ab-4d80-8020-4fcaf40cd039 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:34.958772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4f6c8853-91ab-4d80-8020-4fcaf40cd039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:35.114954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 505/1006] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:34 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:35.215939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec516-a490-47d5-bc03-ea00308944fb None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:35.254910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:35.415210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec516-a490-47d5-bc03-ea00308944fb None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:35.440172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c8853-91ab-4d80-8020-4fcaf40cd039 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:35.487023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:35.488111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:35.488629 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:35.489092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:35.490143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:35.492790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:35.510734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:35.512796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:35.514488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 502/1007] 10.222.0.55 () {56 vars in 1126 bytes} [Tue Sep 13 12:18:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:35.519588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:35.624446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c8853-91ab-4d80-8020-4fcaf40cd039 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:35.653693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:35.670759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:35.679634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:35.681364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:35.682045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:35.682765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] PATH_INFO: `/v3/services/image` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:35.683906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:35.686459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:35.700913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca957db-0b3a-40b3-8c3c-68964579d843 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:35.707921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:35.709385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:35.710220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:35.710962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 506/1008] 10.222.0.55 () {56 vars in 1105 bytes} [Tue Sep 13 12:18:35 2022] GET /identity/v3/services/image => generated 86 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:35.720901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:35.762212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:35.762834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:35.763830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:35.764122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:35.764829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:35.765131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:35.767153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:35.773928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 503/1009] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:35.780774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:35.909056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1159c-f7ca-41d4-8794-f034fbf25f30 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:35.955224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb022859-8f22-418a-88bf-4d7df67edbad None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:35.970498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:35.971542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:35.972022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:35.972549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:35.973652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:35.974184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:35.976768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:35.990734 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 507/1010] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:35.992789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:36.019942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:36.021016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:36.021457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:36.021941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:36.023108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:36.023966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:36.026540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:36.036163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 504/1011] 10.222.0.55 () {56 vars in 1122 bytes} [Tue Sep 13 12:18:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:36.045786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:36.076197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:36.089127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:36.168643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddcba4-519c-426a-a68f-144d982551a8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:36.228748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200c2d-cdf0-43ba-b982-2c1bbdef7a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:36.229739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200c2d-cdf0-43ba-b982-2c1bbdef7a96 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:36.230015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200c2d-cdf0-43ba-b982-2c1bbdef7a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:36.230427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200c2d-cdf0-43ba-b982-2c1bbdef7a96 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:36.231579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200c2d-cdf0-43ba-b982-2c1bbdef7a96 None admin] RBAC: Adding query filter params (type=image) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:36.231922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200c2d-cdf0-43ba-b982-2c1bbdef7a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:36.233820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200c2d-cdf0-43ba-b982-2c1bbdef7a96 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:36.252433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 508/1012] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:36.256917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4310900-11a6-47dc-9fae-ab47e0e4653a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:36.330026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11918c2-9810-40c1-a4f2-8291d5c0ee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:36.331090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11918c2-9810-40c1-a4f2-8291d5c0ee25 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:36.331576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11918c2-9810-40c1-a4f2-8291d5c0ee25 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:36.332081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11918c2-9810-40c1-a4f2-8291d5c0ee25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:36.333524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11918c2-9810-40c1-a4f2-8291d5c0ee25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:36.336230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11918c2-9810-40c1-a4f2-8291d5c0ee25 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:36.376427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 505/1013] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:18:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:18:37.513004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7621-a289-4334-8c23-494d5910288e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:37.513846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7621-a289-4334-8c23-494d5910288e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:37.513846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7621-a289-4334-8c23-494d5910288e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:37.515190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 509/1014] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:37.521404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5571-dd8a-4c62-b1ea-27d675fb79e9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:37.522160 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5571-dd8a-4c62-b1ea-27d675fb79e9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:37.522160 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5571-dd8a-4c62-b1ea-27d675fb79e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:37.543340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-81ba5571-dd8a-4c62-b1ea-27d675fb79e9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:37.544748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-81ba5571-dd8a-4c62-b1ea-27d675fb79e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:37.644325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:37.654933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 506/1015] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:37 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:37.929801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b7621-a289-4334-8c23-494d5910288e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:38.055428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b7621-a289-4334-8c23-494d5910288e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:38.071926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:38.113235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df5c70-5d78-400d-b59a-9bf1f3922101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:38.114352 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df5c70-5d78-400d-b59a-9bf1f3922101 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:38.114854 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df5c70-5d78-400d-b59a-9bf1f3922101 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:38.115339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df5c70-5d78-400d-b59a-9bf1f3922101 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:38.137641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df5c70-5d78-400d-b59a-9bf1f3922101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-95df5c70-5d78-400d-b59a-9bf1f3922101 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:38.147466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:38.148908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:38.149768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:38.153450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 510/1016] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Sep 13 12:18:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:38.157598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5571-dd8a-4c62-b1ea-27d675fb79e9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:38.303264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5571-dd8a-4c62-b1ea-27d675fb79e9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:38.347619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:38.348289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:38.348719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:38.349056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:38.349725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:38.350138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:38.351586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:38.362975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 507/1017] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Sep 13 12:18:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:38.370346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df5c70-5d78-400d-b59a-9bf1f3922101 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:38.581279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df5c70-5d78-400d-b59a-9bf1f3922101 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:38.650767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:38.651890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:38.652416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:38.652928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:38.674266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:38.677087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:38.705730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:38.706798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:38.707687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:38.707687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:38.707687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:38.713105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 511/1018] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:38.715182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:38.844862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:38.928429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441e95f-c4bd-4c0a-900e-1860e9735f80 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:38.995805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:38.996936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:38.997414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:38.997891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:38.999130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:38.999652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:39.002461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:39.027705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 508/1019] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:39.034612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:39.082745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:39.226709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a2c20-21c7-4c4a-bcbe-85e29326bede None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:39.294906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:39.295996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:39.296510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:39.297061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:39.312274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:39.315011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:39.335583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:39.336951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:39.337898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 512/1020] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:18:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:39.345378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:39.490995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150077d-28e5-4894-b8db-e0f092180ed5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:39.523813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:39.549190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8cb9e-76c6-4913-947e-a8eda06a2c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:39.550873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8cb9e-76c6-4913-947e-a8eda06a2c48 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:39.551650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8cb9e-76c6-4913-947e-a8eda06a2c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:39.552358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8cb9e-76c6-4913-947e-a8eda06a2c48 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:39.554133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8cb9e-76c6-4913-947e-a8eda06a2c48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:39.555008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8cb9e-76c6-4913-947e-a8eda06a2c48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:39.558202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8cb9e-76c6-4913-947e-a8eda06a2c48 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:39.587143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 509/1021] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:18:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:39.594499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:39.756563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3fc1-6076-41fb-8a41-59510a57c984 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:39.757104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3fc1-6076-41fb-8a41-59510a57c984 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:39.757445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3fc1-6076-41fb-8a41-59510a57c984 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:39.760603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 510/1022] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:39.763876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:39.769255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbab83-3b09-46af-8a39-b014b7c22bdd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:39.769685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbab83-3b09-46af-8a39-b014b7c22bdd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:39.770163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbab83-3b09-46af-8a39-b014b7c22bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:39.792988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd532fa-d05f-4a45-83b7-50f2eefbf7f8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:39.799510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1ffbab83-3b09-46af-8a39-b014b7c22bdd None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:39.801173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1ffbab83-3b09-46af-8a39-b014b7c22bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:39.862145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9308-61fe-4a80-b285-2dbc43f8eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:39.863209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9308-61fe-4a80-b285-2dbc43f8eb0c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:39.863726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9308-61fe-4a80-b285-2dbc43f8eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:39.864190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9308-61fe-4a80-b285-2dbc43f8eb0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:39.894306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 511/1023] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:39 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:39.897131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f9fd-c21f-4646-97b6-de44c511e230 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:39.897393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f9fd-c21f-4646-97b6-de44c511e230 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:39.897690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f9fd-c21f-4646-97b6-de44c511e230 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:39.899635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 512/1024] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:39.905612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b93ad-8620-4a88-aebe-d02f6dbe2aa7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:39.905945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b93ad-8620-4a88-aebe-d02f6dbe2aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:39.906339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b93ad-8620-4a88-aebe-d02f6dbe2aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:39.928630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-399b93ad-8620-4a88-aebe-d02f6dbe2aa7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:39.929883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-399b93ad-8620-4a88-aebe-d02f6dbe2aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:39.973837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9308-61fe-4a80-b285-2dbc43f8eb0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:39.975890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9308-61fe-4a80-b285-2dbc43f8eb0c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:40.027816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 513/1025] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:39 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:40.083211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:40.110474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 513/1026] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:39 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:18:40.111868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b93ad-8620-4a88-aebe-d02f6dbe2aa7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:40.165924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:40.242096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b93ad-8620-4a88-aebe-d02f6dbe2aa7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:40.283906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:40.284478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:40.284757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:40.285027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:40.297637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:40.299149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:40.301105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9308-61fe-4a80-b285-2dbc43f8eb0c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:40.318854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:40.320940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:40.322712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:40.322712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:40.322712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:40.322712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 514/1027] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:40.326143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:40.431146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9308-61fe-4a80-b285-2dbc43f8eb0c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:40.454697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:40.472728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61fdf9-2bbc-470b-bb3f-15eb41438870 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:40.482369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12435aae-7b77-4493-87ae-1a139ce8e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:40.483735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12435aae-7b77-4493-87ae-1a139ce8e427 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:40.484202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12435aae-7b77-4493-87ae-1a139ce8e427 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:40.484755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12435aae-7b77-4493-87ae-1a139ce8e427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:40.487135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12435aae-7b77-4493-87ae-1a139ce8e427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:40.490021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12435aae-7b77-4493-87ae-1a139ce8e427 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:40.493109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 514/1028] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:40.494469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12435aae-7b77-4493-87ae-1a139ce8e427 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:40.519274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:40.520167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:40.520576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:40.520925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:40.521959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:40.522347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:40.524223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:40.538819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 515/1029] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:40.539571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:40.568043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:40.630821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12435aae-7b77-4493-87ae-1a139ce8e427 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:40.677732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09734b-ae76-40b7-8dd7-af6d546e3f4f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:40.686564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffca56-786d-4a74-9cc1-3bc82b1a99ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:40.687926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffca56-786d-4a74-9cc1-3bc82b1a99ba None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:40.689220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffca56-786d-4a74-9cc1-3bc82b1a99ba None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:40.689720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffca56-786d-4a74-9cc1-3bc82b1a99ba None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:40.691086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffca56-786d-4a74-9cc1-3bc82b1a99ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:40.693746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffca56-786d-4a74-9cc1-3bc82b1a99ba None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:40.718960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686cc80-0cd2-419c-94dc-ec7f4ea924b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:40.719960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686cc80-0cd2-419c-94dc-ec7f4ea924b5 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:40.720302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686cc80-0cd2-419c-94dc-ec7f4ea924b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:40.720631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 515/1030] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:18:40 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:40.722333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffca56-786d-4a74-9cc1-3bc82b1a99ba None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:40.724640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686cc80-0cd2-419c-94dc-ec7f4ea924b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:40.725810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686cc80-0cd2-419c-94dc-ec7f4ea924b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:40.728056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686cc80-0cd2-419c-94dc-ec7f4ea924b5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:40.780463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 516/1031] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:18:40 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:40.908764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffca56-786d-4a74-9cc1-3bc82b1a99ba None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:40.929365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:40.985080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:40.986170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:40.986660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:40.987138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:41.001258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:41.004135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:41.027783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:41.028887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:41.029797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:41.029797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:41.029797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:41.029797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:41.029797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:41.029797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:41.029797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:41.029797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:41.030698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 516/1032] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:41.040465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686cc80-0cd2-419c-94dc-ec7f4ea924b5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:41.048379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:41.245319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686cc80-0cd2-419c-94dc-ec7f4ea924b5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:41.314186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c6705-e621-444b-b187-231c0e9e22fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:41.315214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c6705-e621-444b-b187-231c0e9e22fc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:41.315698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c6705-e621-444b-b187-231c0e9e22fc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:41.316157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c6705-e621-444b-b187-231c0e9e22fc None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:41.317489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c6705-e621-444b-b187-231c0e9e22fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:41.318013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c6705-e621-444b-b187-231c0e9e22fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:41.320799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c6705-e621-444b-b187-231c0e9e22fc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:41.345646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 517/1033] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:41.355509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:41.542072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b23027-2e39-4f1b-835a-2f916a7bf6df None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:41.611176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0fecb-bfe0-40ba-8e25-76057aff14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:41.612173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0fecb-bfe0-40ba-8e25-76057aff14cd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:41.612694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0fecb-bfe0-40ba-8e25-76057aff14cd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:41.613163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0fecb-bfe0-40ba-8e25-76057aff14cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:41.614519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0fecb-bfe0-40ba-8e25-76057aff14cd None admin] RBAC: Adding query filter params (role.id=d681a5a8fabe45de816073236bd6984b, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=536e042f0d76408b9379af15526878b3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:41.615049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0fecb-bfe0-40ba-8e25-76057aff14cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:41.617787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0fecb-bfe0-40ba-8e25-76057aff14cd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:41.629093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 517/1034] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:41 2022] GET /identity/v3/role_assignments?user.id=536e042f0d76408b9379af15526878b3&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=d681a5a8fabe45de816073236bd6984b => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:43.292968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29092-cc68-4df1-8e7a-9d53a0007efd None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:43.293687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29092-cc68-4df1-8e7a-9d53a0007efd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:43.293687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29092-cc68-4df1-8e7a-9d53a0007efd None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:43.295196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 518/1035] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:43.302662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202bc3a-32ec-40b0-99ec-72cb52fe113f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:43.303231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202bc3a-32ec-40b0-99ec-72cb52fe113f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:43.303592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202bc3a-32ec-40b0-99ec-72cb52fe113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:43.325540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c202bc3a-32ec-40b0-99ec-72cb52fe113f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:43.326769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c202bc3a-32ec-40b0-99ec-72cb52fe113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:43.359459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:43.391846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aefc8e-2d4d-4863-b83f-c6f15fd1103d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:43.392134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aefc8e-2d4d-4863-b83f-c6f15fd1103d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:43.392560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aefc8e-2d4d-4863-b83f-c6f15fd1103d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:43.394319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 519/1036] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:43.400510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26636-55e5-47dc-ab6a-9670ed53bc2a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:43.401033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26636-55e5-47dc-ab6a-9670ed53bc2a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:43.401465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26636-55e5-47dc-ab6a-9670ed53bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:43.424705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-eef26636-55e5-47dc-ab6a-9670ed53bc2a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:43.426192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-eef26636-55e5-47dc-ab6a-9670ed53bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:43.444445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 518/1037] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:43.545819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:43.558228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 520/1038] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:43.718900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202bc3a-32ec-40b0-99ec-72cb52fe113f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:43.857112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202bc3a-32ec-40b0-99ec-72cb52fe113f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:43.882066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46863a9b-96c6-44b1-b8e7-5d698149b7a9 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:43.882345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46863a9b-96c6-44b1-b8e7-5d698149b7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:43.882720 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46863a9b-96c6-44b1-b8e7-5d698149b7a9 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:43.884304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 521/1039] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:43.894142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabb8b-1d29-4f2b-9c69-782eb50ecdb7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:43.894927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabb8b-1d29-4f2b-9c69-782eb50ecdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:43.895599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdabb8b-1d29-4f2b-9c69-782eb50ecdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:43.911789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:43.912494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:43.912782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:43.913059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] PATH_INFO: `/v3/services/image` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:43.913660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:43.915082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:43.922587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4cdabb8b-1d29-4f2b-9c69-782eb50ecdb7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:43.924100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4cdabb8b-1d29-4f2b-9c69-782eb50ecdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:43.925244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:43.926224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:43.927156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 519/1040] 10.222.0.55 () {56 vars in 1105 bytes} [Tue Sep 13 12:18:43 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:43.932973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:43.983296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:44.006280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 522/1041] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:44.085259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986b3c1-d7a0-467a-a7c8-1fe24f11a455 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:44.097512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdabb8b-1d29-4f2b-9c69-782eb50ecdb7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:44.135595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:44.136732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:44.137204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:44.137702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:44.138952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] RBAC: Adding query filter params (name=image) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:44.139529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:44.142509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:44.156490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 520/1042] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:44.161710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:44.247643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdabb8b-1d29-4f2b-9c69-782eb50ecdb7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:44.278142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:44.292002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbcbbe-af2c-4047-a61d-c9ac3bee4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:44.292698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbcbbe-af2c-4047-a61d-c9ac3bee4b83 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:44.292974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbcbbe-af2c-4047-a61d-c9ac3bee4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:44.293244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbcbbe-af2c-4047-a61d-c9ac3bee4b83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:44.294615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbcbbe-af2c-4047-a61d-c9ac3bee4b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:44.296127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbcbbe-af2c-4047-a61d-c9ac3bee4b83 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:44.298378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 523/1043] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:44.299187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbcbbe-af2c-4047-a61d-c9ac3bee4b83 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:44.335551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:44.351525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e4df7-7916-4e5f-88e5-2966ec575677 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:44.408034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:44.409047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:44.409530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:44.410036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:44.411216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] RBAC: Adding query filter params (type=image) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:44.411775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:44.414460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:44.423090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 521/1044] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:44.423964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:44.440928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbcbbe-af2c-4047-a61d-c9ac3bee4b83 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:44.495290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282563-30a3-4438-b0da-833cd6acb129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:44.496216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282563-30a3-4438-b0da-833cd6acb129 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:44.496701 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282563-30a3-4438-b0da-833cd6acb129 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:44.497136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282563-30a3-4438-b0da-833cd6acb129 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:44.514634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282563-30a3-4438-b0da-833cd6acb129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-50282563-30a3-4438-b0da-833cd6acb129 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:44.520883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:44.523084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 524/1045] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Sep 13 12:18:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:44.525541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282563-30a3-4438-b0da-833cd6acb129 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:44.589170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9345-5aa1-4bbd-a9ac-911ba79c2247 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:44.614724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:44.648754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1929b-12f6-4b9d-9e07-d343c6a0d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:44.649764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1929b-12f6-4b9d-9e07-d343c6a0d204 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:44.650220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1929b-12f6-4b9d-9e07-d343c6a0d204 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:44.650686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1929b-12f6-4b9d-9e07-d343c6a0d204 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:44.651826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1929b-12f6-4b9d-9e07-d343c6a0d204 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:44.654475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1929b-12f6-4b9d-9e07-d343c6a0d204 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:44.676305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282563-30a3-4438-b0da-833cd6acb129 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:44.694156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 522/1046] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:18:44 2022] POST /identity/v3/users => generated 285 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:44.695321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1929b-12f6-4b9d-9e07-d343c6a0d204 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:44.721499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:44.728553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:44.729462 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:44.729931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:44.730404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:44.731500 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] RBAC: Adding query filter params (interface=public, service_id=284358c7d3584424a482ee7bd3e39969, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:44.732036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:44.734442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:44.748537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 525/1047] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Sep 13 12:18:44 2022] GET /identity/v3/endpoints?service_id=284358c7d3584424a482ee7bd3e39969&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:44.750214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:44.893738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1929b-12f6-4b9d-9e07-d343c6a0d204 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:44.934206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ceb64-183a-4cf7-ae06-b2b712406991 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:44.957141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:44.958127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:44.958521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:44.958899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:44.960015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:44.960493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:44.962622 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:44.965292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:44.981234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 523/1048] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Sep 13 12:18:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:44.989800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:44.998367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363ed8-d635-46bb-8a40-361d1440c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:45.000301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363ed8-d635-46bb-8a40-361d1440c063 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:45.000301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363ed8-d635-46bb-8a40-361d1440c063 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:45.000301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363ed8-d635-46bb-8a40-361d1440c063 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:45.001203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76363ed8-d635-46bb-8a40-361d1440c063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:45.003344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76363ed8-d635-46bb-8a40-361d1440c063 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:45.015432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 526/1049] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:18:44 2022] GET /identity/v3/services => generated 1957 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:18:45.130199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:45.192906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1d796-b887-4a73-9890-9003b6fbac78 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:45.263941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:45.265131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:45.266467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:45.266962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:45.289095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:45.291430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:45.323691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:45.325818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:45.327576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:45.327576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:45.327576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:45.327576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 524/1050] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:45.335516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363ed8-d635-46bb-8a40-361d1440c063 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:45.561159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363ed8-d635-46bb-8a40-361d1440c063 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:45.637090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:45.638126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:45.638600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:45.639068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:45.640234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:45.641867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:45.644628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:45.673506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 527/1051] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:45.675643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:45.884061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de7f2-85c2-4233-b897-619ab7d4c748 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:45.932997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:45.958535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:45.959577 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:45.960051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:45.960564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:45.978114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:45.980822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:45.996995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:45.998971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:46.000908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 525/1052] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:18:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:46.004872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:46.056765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:46.130924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8452-08bc-4c3e-8746-380017e92aad None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:46.175647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:46.176161 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:46.176477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:46.176753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:46.177534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:46.177839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:46.179324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:46.199754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 528/1053] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:18:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:46.206508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:46.411328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aad1a-3250-4148-88cb-b74f7b52a7c0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:46.477186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:46.477739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:46.478019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:46.478289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:46.492468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:46.493973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:46.511452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:46.512827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:46.513745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:46.513745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:46.513745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:46.513745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 526/1054] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:46.521765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:46.647696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:46.653880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354fbb9-f977-4672-8eea-7fa347adffb2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:46.698717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:46.699866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:46.700442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:46.700939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:46.701822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:46.702339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:46.704470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:46.718668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 529/1055] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:46.728579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:46.775807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:46.864665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf526de7-58bb-4cde-96c1-6641f365edfe None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:46.908435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:46.909550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:46.910053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:46.910529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:46.919034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:46.920985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:46.936266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:46.937405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:46.938986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:46.938986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:46.938986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:46.938986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:46.938986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:46.938986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:46.938986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:46.938986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:46.939763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 527/1056] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:46.949992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:47.075313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ecfb-e919-4a66-9a6b-d48494548797 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:47.122339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13597241-962f-4066-8d47-316084cf5cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:47.123410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597241-962f-4066-8d47-316084cf5cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:47.123906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597241-962f-4066-8d47-316084cf5cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:47.124414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597241-962f-4066-8d47-316084cf5cc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:47.126572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13597241-962f-4066-8d47-316084cf5cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:47.127123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13597241-962f-4066-8d47-316084cf5cc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:47.130036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13597241-962f-4066-8d47-316084cf5cc1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:47.160439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 530/1057] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:47.164296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:47.364342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:47.377725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cba35-6bed-4370-b744-5606fda3d53a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:47.423113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ec1c-ed16-4200-8e90-6baf70e2d2fa None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:47.423521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ec1c-ed16-4200-8e90-6baf70e2d2fa None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:47.423688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ec1c-ed16-4200-8e90-6baf70e2d2fa None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:47.425428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 531/1058] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:47.433611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6c260-6b35-4d6a-a5bf-14d1fc1eeb14 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:47.433875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6c260-6b35-4d6a-a5bf-14d1fc1eeb14 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:47.434234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6c260-6b35-4d6a-a5bf-14d1fc1eeb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:47.447522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb15f7-b970-4613-9e78-a4fe166c7f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:47.449897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb15f7-b970-4613-9e78-a4fe166c7f94 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:47.450379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb15f7-b970-4613-9e78-a4fe166c7f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:47.450869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb15f7-b970-4613-9e78-a4fe166c7f94 None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/536e042f0d76408b9379af15526878b3/roles/d681a5a8fabe45de816073236bd6984b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:47.455032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb15f7-b970-4613-9e78-a4fe166c7f94 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=536e042f0d76408b9379af15526878b3, role_id=d681a5a8fabe45de816073236bd6984b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:47.456069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a1c6c260-6b35-4d6a-a5bf-14d1fc1eeb14 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:47.457459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a1c6c260-6b35-4d6a-a5bf-14d1fc1eeb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:47.457709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb15f7-b970-4613-9e78-a4fe166c7f94 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:47.481675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:47.487087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 528/1059] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:18:47 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/536e042f0d76408b9379af15526878b3/roles/d681a5a8fabe45de816073236bd6984b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:18:47.604452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 532/1060] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:47.880707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5ed2-b10f-4890-96e3-c5efb54618f7 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:47.881521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5ed2-b10f-4890-96e3-c5efb54618f7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:47.881689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5ed2-b10f-4890-96e3-c5efb54618f7 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:47.884662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 529/1061] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:47.893338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ca67-ec46-433b-a735-302384afb816 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:47.893827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ca67-ec46-433b-a735-302384afb816 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:47.894298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ca67-ec46-433b-a735-302384afb816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:47.926988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e939ca67-ec46-433b-a735-302384afb816 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:47.929041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e939ca67-ec46-433b-a735-302384afb816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:48.057965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 533/1062] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:48.086337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5ed2-b10f-4890-96e3-c5efb54618f7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:48.295831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5ed2-b10f-4890-96e3-c5efb54618f7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:48.357274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939ca67-ec46-433b-a735-302384afb816 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:48.366390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478bcb-58e6-4c84-8584-bd99a3317805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:48.368370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478bcb-58e6-4c84-8584-bd99a3317805 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:48.368893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478bcb-58e6-4c84-8584-bd99a3317805 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:48.369372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478bcb-58e6-4c84-8584-bd99a3317805 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:48.390801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478bcb-58e6-4c84-8584-bd99a3317805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3f478bcb-58e6-4c84-8584-bd99a3317805 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:48.400696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:48.401724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:18:48.402667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:48.403316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 530/1063] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:18:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:48.412955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478bcb-58e6-4c84-8584-bd99a3317805 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:48.444831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:48.489743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:48.531474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939ca67-ec46-433b-a735-302384afb816 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:48.582896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478bcb-58e6-4c84-8584-bd99a3317805 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:48.589597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:48.590588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:48.591025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:48.591456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] PATH_INFO: `/v3/services/image` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:48.592483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:48.594995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:48.609890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:48.612523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:48.613370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 534/1064] 10.222.0.55 () {56 vars in 1105 bytes} [Tue Sep 13 12:18:48 2022] GET /identity/v3/services/image => generated 86 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:48.621223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:48.643407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:48.644423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:48.644870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:48.645332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:48.646505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:48.646984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:48.649210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:48.662020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 531/1065] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:48.669072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:48.788237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:48.805692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e24c76-8c54-4e0f-9c94-340e5b7a200d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:48.832562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599d3f-d577-47cf-aa1d-b6ed1ff696e1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:48.854388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:48.855425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:48.855805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:48.856217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:48.857180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] RBAC: Adding query filter params (name=image) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:48.857683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:48.859318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:48.868453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 535/1066] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:48.873121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:48.886254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:48.905063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0235a-8b88-4be8-9d5c-bfb7fe953eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:48.907005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0235a-8b88-4be8-9d5c-bfb7fe953eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:48.907493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0235a-8b88-4be8-9d5c-bfb7fe953eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:48.908187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0235a-8b88-4be8-9d5c-bfb7fe953eb9 None admin] PATH_INFO: `/v3/users/54133f780121498899697018b5214fc8` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:48.932537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0235a-8b88-4be8-9d5c-bfb7fe953eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=54133f780121498899697018b5214fc8)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:48.935095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0235a-8b88-4be8-9d5c-bfb7fe953eb9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:48.938514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 532/1067] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:18:48 2022] GET /identity/v3/users/54133f780121498899697018b5214fc8 => generated 285 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:48.947091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0235a-8b88-4be8-9d5c-bfb7fe953eb9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:49.051993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5ec81-11ed-41e3-ae14-3f4377c2be8b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:49.113721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:49.114012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0235a-8b88-4be8-9d5c-bfb7fe953eb9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:49.114523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:49.114935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:49.115335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:49.116138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:49.116829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:49.119326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:49.131032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 536/1068] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:49.132412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:49.175545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7129f-a318-4b3f-8e64-0d21c2e27892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:49.176523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7129f-a318-4b3f-8e64-0d21c2e27892 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:49.176980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7129f-a318-4b3f-8e64-0d21c2e27892 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:49.177387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7129f-a318-4b3f-8e64-0d21c2e27892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:49.183423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:49.249620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:49.297581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7129f-a318-4b3f-8e64-0d21c2e27892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:49.297911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00ff50-94b6-4766-ae6f-22675282e7c9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:49.300243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7129f-a318-4b3f-8e64-0d21c2e27892 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:49.349572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ac61-021c-4bd0-924d-9a9957bc3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:49.350587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ac61-021c-4bd0-924d-9a9957bc3b8f None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:49.351056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ac61-021c-4bd0-924d-9a9957bc3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:49.351551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ac61-021c-4bd0-924d-9a9957bc3b8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:49.352731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964ac61-021c-4bd0-924d-9a9957bc3b8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:49.355196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964ac61-021c-4bd0-924d-9a9957bc3b8f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:49.392109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 537/1069] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:18:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:18:49.507055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 533/1070] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:18:49.519341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ac61-021c-4bd0-924d-9a9957bc3b8f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:49.742504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ac61-021c-4bd0-924d-9a9957bc3b8f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:49.788926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:49.806414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a08f0c-40ef-468b-bbe7-9627f0ec671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:49.807084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a08f0c-40ef-468b-bbe7-9627f0ec671d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:49.807361 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a08f0c-40ef-468b-bbe7-9627f0ec671d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:49.807633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a08f0c-40ef-468b-bbe7-9627f0ec671d None admin] PATH_INFO: `/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:49.808947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a08f0c-40ef-468b-bbe7-9627f0ec671d None admin] RBAC: Authorizing `identity:get_project(project_id=3b61561d5e154967a3d6dba1a8c0d6a6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:49.810491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a08f0c-40ef-468b-bbe7-9627f0ec671d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:49.813084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 538/1071] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:18:49 2022] GET /identity/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6 => generated 311 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:49.819889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7129f-a318-4b3f-8e64-0d21c2e27892 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:49.880145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:49.960955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7129f-a318-4b3f-8e64-0d21c2e27892 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:50.003434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d424a-bc37-4860-b50e-040fbe6f5a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:50.004328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d424a-bc37-4860-b50e-040fbe6f5a79 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:50.004786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d424a-bc37-4860-b50e-040fbe6f5a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:50.005194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d424a-bc37-4860-b50e-040fbe6f5a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:50.006082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d424a-bc37-4860-b50e-040fbe6f5a79 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=3b61561d5e154967a3d6dba1a8c0d6a6, user.id=54133f780121498899697018b5214fc8) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:50.006535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d424a-bc37-4860-b50e-040fbe6f5a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:50.008175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d424a-bc37-4860-b50e-040fbe6f5a79 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:50.015321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 534/1072] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:49 2022] GET /identity/v3/role_assignments?user.id=54133f780121498899697018b5214fc8&scope.project.id=3b61561d5e154967a3d6dba1a8c0d6a6&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:50.240767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260b045-c0b2-47e1-a262-35bfefd2502b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:50.241258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260b045-c0b2-47e1-a262-35bfefd2502b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:50.241731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260b045-c0b2-47e1-a262-35bfefd2502b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:50.244265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 539/1073] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:50.253207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fe067-9839-4058-b00b-163dc22759bc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:50.253754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fe067-9839-4058-b00b-163dc22759bc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:50.254170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fe067-9839-4058-b00b-163dc22759bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:50.285682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b30fe067-9839-4058-b00b-163dc22759bc None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:50.287631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b30fe067-9839-4058-b00b-163dc22759bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:50.413197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 535/1074] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:50.890515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260b045-c0b2-47e1-a262-35bfefd2502b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:51.072011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260b045-c0b2-47e1-a262-35bfefd2502b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:51.117000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ddf49-b035-40d3-9f43-9eea05a07ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:51.117660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ddf49-b035-40d3-9f43-9eea05a07ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:51.117938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ddf49-b035-40d3-9f43-9eea05a07ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:51.118198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ddf49-b035-40d3-9f43-9eea05a07ad5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:51.136689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ddf49-b035-40d3-9f43-9eea05a07ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-929ddf49-b035-40d3-9f43-9eea05a07ad5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:51.142308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:51.144505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:51.146373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 540/1075] 10.222.0.55 () {56 vars in 1120 bytes} [Tue Sep 13 12:18:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:51.152906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fe067-9839-4058-b00b-163dc22759bc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:51.190965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:51.286307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fe067-9839-4058-b00b-163dc22759bc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:51.332495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:51.333146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:51.333426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:51.333701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:51.334422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:51.334722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:51.336265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:51.352174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 536/1076] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Sep 13 12:18:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:51.353695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ddf49-b035-40d3-9f43-9eea05a07ad5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:51.454537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:51.563218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ddf49-b035-40d3-9f43-9eea05a07ad5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:51.634584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:51.635776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:51.636291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:51.636812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:51.660021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:51.662914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:51.692185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:51.694039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:51.696604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:51.696604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:51.696604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:51.696604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 541/1077] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:51.704739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:51.886322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:51.904582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0820f-1336-471f-8c87-719e25c61a24 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:51.962931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:51.963465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:51.963740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:51.964002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:51.964791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:51.965101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:51.966521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:51.982095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 537/1078] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:51.990322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:52.122031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596623ab-9941-4f3e-b9f6-98a106cc0388 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:52.124051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:52.172521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0382e4-d407-4fa4-9b58-fb1453cb54f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:52.173347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0382e4-d407-4fa4-9b58-fb1453cb54f3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:52.173637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0382e4-d407-4fa4-9b58-fb1453cb54f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:52.173933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0382e4-d407-4fa4-9b58-fb1453cb54f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:52.183333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0382e4-d407-4fa4-9b58-fb1453cb54f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:52.184861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0382e4-d407-4fa4-9b58-fb1453cb54f3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ba0382e4-d407-4fa4-9b58-fb1453cb54f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:18:52.198358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:52.200238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:18:52.202651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:52.204903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 542/1079] 10.222.0.55 () {56 vars in 1093 bytes} [Tue Sep 13 12:18:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:52.207624 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:52.268331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843981f0-a321-4d76-a401-79d4eb786057 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:52.268575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843981f0-a321-4d76-a401-79d4eb786057 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:52.268828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843981f0-a321-4d76-a401-79d4eb786057 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:52.270410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 543/1080] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:52.276484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3f4f2-8301-4ad1-bc0e-d1de8489e99f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:52.276817 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3f4f2-8301-4ad1-bc0e-d1de8489e99f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:52.277005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3f4f2-8301-4ad1-bc0e-d1de8489e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:52.298098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fae3f4f2-8301-4ad1-bc0e-d1de8489e99f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:52.299359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fae3f4f2-8301-4ad1-bc0e-d1de8489e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:52.381745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f1831-8e57-4318-8901-4f3b25b898d7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:52.402908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 544/1081] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:18:52.431959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:52.432828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:52.433110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:52.433377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:52.434146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:52.434453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:52.435946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:52.465401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 538/1082] 10.222.0.55 () {56 vars in 1133 bytes} [Tue Sep 13 12:18:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:52.470292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3f4f2-8301-4ad1-bc0e-d1de8489e99f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:52.656343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:52.675234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3f4f2-8301-4ad1-bc0e-d1de8489e99f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:52.741920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73cde8-3681-4301-af1b-baf2846adafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:52.742908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73cde8-3681-4301-af1b-baf2846adafb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:52.743391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73cde8-3681-4301-af1b-baf2846adafb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:52.743872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73cde8-3681-4301-af1b-baf2846adafb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:52.824917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:52.845192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:52.869224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73cde8-3681-4301-af1b-baf2846adafb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:52.871627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73cde8-3681-4301-af1b-baf2846adafb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:52.997607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b02a4-66f2-4e5b-bdf6-98817f221ffd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:53.012776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:53.024951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 545/1083] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:18:53.031978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73cde8-3681-4301-af1b-baf2846adafb None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:53.062579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8979f1-f20a-4047-b836-a64009021664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:53.063557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8979f1-f20a-4047-b836-a64009021664 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:53.063832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8979f1-f20a-4047-b836-a64009021664 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:53.064641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8979f1-f20a-4047-b836-a64009021664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:53.169329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8979f1-f20a-4047-b836-a64009021664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:53.170828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8979f1-f20a-4047-b836-a64009021664 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:53.184719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:53.189013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73cde8-3681-4301-af1b-baf2846adafb None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:53.239010 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163805a5-2bec-4207-88b2-2cdc9b5f1d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:53.239793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163805a5-2bec-4207-88b2-2cdc9b5f1d37 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:53.240166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163805a5-2bec-4207-88b2-2cdc9b5f1d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:53.240595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163805a5-2bec-4207-88b2-2cdc9b5f1d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:53.254190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163805a5-2bec-4207-88b2-2cdc9b5f1d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:53.256023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163805a5-2bec-4207-88b2-2cdc9b5f1d37 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-163805a5-2bec-4207-88b2-2cdc9b5f1d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:53.282669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:53.284276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 546/1084] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d946f-2923-41cf-b87c-12a93ef0257d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d946f-2923-41cf-b87c-12a93ef0257d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d946f-2923-41cf-b87c-12a93ef0257d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 547/1085] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:18:53.291319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d946f-2923-41cf-b87c-12a93ef0257d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:53.325893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 539/1086] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:18:53.327387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9af835-e0f8-4af7-a78a-fbbbd6c366b7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:53.328225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9af835-e0f8-4af7-a78a-fbbbd6c366b7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:53.328983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9af835-e0f8-4af7-a78a-fbbbd6c366b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:53.353350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3a9af835-e0f8-4af7-a78a-fbbbd6c366b7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:53.355274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3a9af835-e0f8-4af7-a78a-fbbbd6c366b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:53.367379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:53.454049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 540/1087] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:53.454863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9af835-e0f8-4af7-a78a-fbbbd6c366b7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:53.468925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d946f-2923-41cf-b87c-12a93ef0257d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:53.525125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:53.529144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:53.530466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:53.531172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:53.531410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:53.532611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:53.533225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:53.536414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:53.561012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 548/1088] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:53.569760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:53.637067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9af835-e0f8-4af7-a78a-fbbbd6c366b7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:53.701079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:53.702093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:53.702533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:53.703384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:53.723293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:53.724769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:53.740194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298fc54-926f-4e65-bf27-d989f915f045 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:53.743944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:18:53.755124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:53.756156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:18:53.757126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:18:53.757126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:18:53.757126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:53.757126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 541/1089] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:53.767791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:53.793487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:53.794765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:53.795106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:53.795381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:53.807185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:53.808921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:18:53.827684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:53.830258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:18:53.832765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 549/1090] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:18:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:53.838441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:53.894631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:53.909081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ac6e-ab5f-47fc-877c-b20af9e079c3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:53.963532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:53.964521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:53.964958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:53.965391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:53.966462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:53.966947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:53.969372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:53.985434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7bf0a-4143-4fda-88dd-5f677446ab9e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:53.987113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 542/1091] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:53.988868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:54.056805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:54.057843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:54.058218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:54.058626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:54.059516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:54.059955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:54.061782 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:54.089272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 550/1092] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:18:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:54.099185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:54.133272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:54.189887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d2d04-4361-49c3-8d27-f7fe1e2e0129 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:54.247216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6702854-67af-4750-abeb-a5982aa83cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:54.248090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6702854-67af-4750-abeb-a5982aa83cbb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:54.248365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6702854-67af-4750-abeb-a5982aa83cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:54.248729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6702854-67af-4750-abeb-a5982aa83cbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:54.263581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6702854-67af-4750-abeb-a5982aa83cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a6702854-67af-4750-abeb-a5982aa83cbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:54.268974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:54.274777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:54.276473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 543/1093] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:18:54.280436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6702854-67af-4750-abeb-a5982aa83cbb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:54.287890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca21e4-3da4-483e-9414-a893689fda32 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:54.303280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:54.338724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:54.339344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:54.339626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:54.339897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:54.341909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] RBAC: Adding query filter params (role.id=d681a5a8fabe45de816073236bd6984b, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=536e042f0d76408b9379af15526878b3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:54.341909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:54.344434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:54.353068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 551/1094] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:54 2022] GET /identity/v3/role_assignments?user.id=536e042f0d76408b9379af15526878b3&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=d681a5a8fabe45de816073236bd6984b => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:54.475101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6702854-67af-4750-abeb-a5982aa83cbb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:54.523776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:54.524748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:54.525140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:54.525541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:54.526440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:54.526912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:54.528700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:54.540014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 544/1095] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:18:54.547387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:54.695425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:54.709793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992dc27-94b2-4c10-8422-2372054100f7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:54.760130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e106314-a00b-463f-a265-7818c5218388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:54.760837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e106314-a00b-463f-a265-7818c5218388 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:54.761113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e106314-a00b-463f-a265-7818c5218388 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:54.761383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e106314-a00b-463f-a265-7818c5218388 None admin] PATH_INFO: `/v3/users/54133f780121498899697018b5214fc8` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:54.762678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e106314-a00b-463f-a265-7818c5218388 None admin] RBAC: Authorizing `identity:get_user(user_id=54133f780121498899697018b5214fc8)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:54.764178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e106314-a00b-463f-a265-7818c5218388 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:54.766317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 552/1096] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:18:54 2022] GET /identity/v3/users/54133f780121498899697018b5214fc8 => generated 285 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:54.772708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:54.889041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:54.927214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330faf1-8b11-4fdb-b357-ac717cc8170d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:54.974957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18a5de-75a2-43e8-8b19-7398bc5992f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:54.975939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18a5de-75a2-43e8-8b19-7398bc5992f4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:54.976443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18a5de-75a2-43e8-8b19-7398bc5992f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:54.976935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18a5de-75a2-43e8-8b19-7398bc5992f4 None admin] PATH_INFO: `/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:54.979039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18a5de-75a2-43e8-8b19-7398bc5992f4 None admin] RBAC: Authorizing `identity:get_project(project_id=3b61561d5e154967a3d6dba1a8c0d6a6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:54.981752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18a5de-75a2-43e8-8b19-7398bc5992f4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:54.985005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 545/1097] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:18:54 2022] GET /identity/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6 => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:54.995681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e106314-a00b-463f-a265-7818c5218388 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:55.169382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e106314-a00b-463f-a265-7818c5218388 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:55.222259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b5eda-d014-4f1c-8995-82fff4d5aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:55.223076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5eda-d014-4f1c-8995-82fff4d5aa48 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:55.223433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5eda-d014-4f1c-8995-82fff4d5aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:55.223794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5eda-d014-4f1c-8995-82fff4d5aa48 None admin] PATH_INFO: `/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6/users/54133f780121498899697018b5214fc8/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:55.226851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b5eda-d014-4f1c-8995-82fff4d5aa48 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b61561d5e154967a3d6dba1a8c0d6a6, user_id=54133f780121498899697018b5214fc8, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:55.229476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b5eda-d014-4f1c-8995-82fff4d5aa48 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:55.249612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 553/1098] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:18:54 2022] PUT /identity/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6/users/54133f780121498899697018b5214fc8/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:18:57.628118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131abc6-b9c4-4096-a538-9782f8d00822 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:57.628867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131abc6-b9c4-4096-a538-9782f8d00822 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:57.628867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131abc6-b9c4-4096-a538-9782f8d00822 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:57.630058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 546/1099] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:18:57.636270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8939-fd55-46c8-a635-7f30654a1b09 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:57.636912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8939-fd55-46c8-a635-7f30654a1b09 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:57.636912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8939-fd55-46c8-a635-7f30654a1b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:57.658637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ebab8939-fd55-46c8-a635-7f30654a1b09 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:57.659885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ebab8939-fd55-46c8-a635-7f30654a1b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:57.676535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:57.745262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 554/1100] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:18:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:18:58.019303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131abc6-b9c4-4096-a538-9782f8d00822 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:58.138479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131abc6-b9c4-4096-a538-9782f8d00822 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:58.199471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53689b25-26a6-4b79-9a42-1c7140e1d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:58.200456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53689b25-26a6-4b79-9a42-1c7140e1d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:58.200885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53689b25-26a6-4b79-9a42-1c7140e1d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:58.201345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53689b25-26a6-4b79-9a42-1c7140e1d0a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:58.217904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53689b25-26a6-4b79-9a42-1c7140e1d0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-53689b25-26a6-4b79-9a42-1c7140e1d0a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:18:58.223665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:18:58.225511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:18:58.227196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 547/1101] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:18:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:18:58.232069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8939-fd55-46c8-a635-7f30654a1b09 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:58.376760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8939-fd55-46c8-a635-7f30654a1b09 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:58.424002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:58.424685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:58.424930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:58.425224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:58.425903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:58.426197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:58.427650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:58.441065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 555/1102] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:58.450700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53689b25-26a6-4b79-9a42-1c7140e1d0a8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:58.454626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:58.570071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53689b25-26a6-4b79-9a42-1c7140e1d0a8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:58.611535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e5bd5-c0cb-45a1-a23d-35d7bdb05494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:58.612194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5bd5-c0cb-45a1-a23d-35d7bdb05494 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:58.612515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5bd5-c0cb-45a1-a23d-35d7bdb05494 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:58.612780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5bd5-c0cb-45a1-a23d-35d7bdb05494 None admin] PATH_INFO: `/v3/users/54133f780121498899697018b5214fc8` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:58.614047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e5bd5-c0cb-45a1-a23d-35d7bdb05494 None admin] RBAC: Authorizing `identity:get_user(user_id=54133f780121498899697018b5214fc8)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:58.615532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e5bd5-c0cb-45a1-a23d-35d7bdb05494 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:58.617301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 548/1103] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:18:58 2022] GET /identity/v3/users/54133f780121498899697018b5214fc8 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:58.623609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:58.636644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:58.742944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37730e6c-2a18-458b-b8fe-b6fda0e2845e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:58.781631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188bf66-4e3f-4c36-bfcf-7acb0ddc33ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:58.782270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188bf66-4e3f-4c36-bfcf-7acb0ddc33ba None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:58.782547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188bf66-4e3f-4c36-bfcf-7acb0ddc33ba None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:58.782820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188bf66-4e3f-4c36-bfcf-7acb0ddc33ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:58.863185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188bf66-4e3f-4c36-bfcf-7acb0ddc33ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:58.864740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188bf66-4e3f-4c36-bfcf-7acb0ddc33ba None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:58.875791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:58.977330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 556/1104] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:18:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:18:58.983731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e5bd5-c0cb-45a1-a23d-35d7bdb05494 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:59.063255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:59.102601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e5bd5-c0cb-45a1-a23d-35d7bdb05494 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:59.144264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae3c6a-8032-4e4e-a753-b2cdad011bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:59.144985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3c6a-8032-4e4e-a753-b2cdad011bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:59.145364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3c6a-8032-4e4e-a753-b2cdad011bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:59.145647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3c6a-8032-4e4e-a753-b2cdad011bb9 None admin] PATH_INFO: `/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:59.146965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae3c6a-8032-4e4e-a753-b2cdad011bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=3b61561d5e154967a3d6dba1a8c0d6a6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:59.148829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae3c6a-8032-4e4e-a753-b2cdad011bb9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:59.150801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 549/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:18:58 2022] GET /identity/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:18:59.158451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188bf66-4e3f-4c36-bfcf-7acb0ddc33ba None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:18:59.279093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188bf66-4e3f-4c36-bfcf-7acb0ddc33ba None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:18:59.290803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:59.321410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494756a-6fc0-4967-a9e8-d3d81f4017e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:18:59.322036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494756a-6fc0-4967-a9e8-d3d81f4017e7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:59.322313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494756a-6fc0-4967-a9e8-d3d81f4017e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:59.322591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494756a-6fc0-4967-a9e8-d3d81f4017e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:59.323320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494756a-6fc0-4967-a9e8-d3d81f4017e7 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=3b61561d5e154967a3d6dba1a8c0d6a6, user.id=54133f780121498899697018b5214fc8) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:18:59.323628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494756a-6fc0-4967-a9e8-d3d81f4017e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:18:59.325151 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494756a-6fc0-4967-a9e8-d3d81f4017e7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:18:59.333032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 557/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:18:59 2022] GET /identity/v3/role_assignments?user.id=54133f780121498899697018b5214fc8&scope.project.id=3b61561d5e154967a3d6dba1a8c0d6a6&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:01.733463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c552b2-62c3-45d7-9c7f-a79ef605eba1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:01.734084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c552b2-62c3-45d7-9c7f-a79ef605eba1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:01.734084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c552b2-62c3-45d7-9c7f-a79ef605eba1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:01.735862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 550/1107] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:01.742333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211650e0-cdde-4f25-b74d-2281f8432172 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:01.742914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211650e0-cdde-4f25-b74d-2281f8432172 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:01.742914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211650e0-cdde-4f25-b74d-2281f8432172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:01.764554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-211650e0-cdde-4f25-b74d-2281f8432172 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:01.766663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-211650e0-cdde-4f25-b74d-2281f8432172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:01.850473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 558/1108] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:02.144748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c552b2-62c3-45d7-9c7f-a79ef605eba1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:02.274985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c552b2-62c3-45d7-9c7f-a79ef605eba1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:02.337730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426600c-a5e9-4739-bda6-a02f4486427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:02.338828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426600c-a5e9-4739-bda6-a02f4486427d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:02.339304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426600c-a5e9-4739-bda6-a02f4486427d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:02.339711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426600c-a5e9-4739-bda6-a02f4486427d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:02.341545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426600c-a5e9-4739-bda6-a02f4486427d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:02.344238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426600c-a5e9-4739-bda6-a02f4486427d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:02.347256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 551/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:19:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:19:02.353839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211650e0-cdde-4f25-b74d-2281f8432172 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:02.475662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211650e0-cdde-4f25-b74d-2281f8432172 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:02.477460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:02.516746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465072f4-a38c-45b9-ac87-af8c0b84676a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:02.517367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465072f4-a38c-45b9-ac87-af8c0b84676a None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:02.517641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465072f4-a38c-45b9-ac87-af8c0b84676a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:02.517880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465072f4-a38c-45b9-ac87-af8c0b84676a None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:02.518587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465072f4-a38c-45b9-ac87-af8c0b84676a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:02.520068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465072f4-a38c-45b9-ac87-af8c0b84676a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:02.545676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 559/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:19:02 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:19:04.879812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a7ba-e6c7-4b60-b1b8-8d0fc38e21a7 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:04.880413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a7ba-e6c7-4b60-b1b8-8d0fc38e21a7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:04.880413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a7ba-e6c7-4b60-b1b8-8d0fc38e21a7 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:04.881780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 552/1111] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:04.888248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf96b-de1e-440b-89e8-fa1f31fd0d7a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:04.888880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf96b-de1e-440b-89e8-fa1f31fd0d7a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:04.888880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf96b-de1e-440b-89e8-fa1f31fd0d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:04.910568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0a7cf96b-de1e-440b-89e8-fa1f31fd0d7a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:04.911824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a7cf96b-de1e-440b-89e8-fa1f31fd0d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:04.989015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 560/1112] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:05.265703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a7ba-e6c7-4b60-b1b8-8d0fc38e21a7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:05.276814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:05.389147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a7ba-e6c7-4b60-b1b8-8d0fc38e21a7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:05.430719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674c0e3-5c7d-4e0c-a86b-5c4cada97064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:05.431384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674c0e3-5c7d-4e0c-a86b-5c4cada97064 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:05.431660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674c0e3-5c7d-4e0c-a86b-5c4cada97064 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:05.431931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674c0e3-5c7d-4e0c-a86b-5c4cada97064 None admin] PATH_INFO: `/v3/roles/6385a2f348c0451081ccf442289790ed` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:05.433597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674c0e3-5c7d-4e0c-a86b-5c4cada97064 None admin] RBAC: Authorizing `identity:get_role(role_id=6385a2f348c0451081ccf442289790ed)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:05.435022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674c0e3-5c7d-4e0c-a86b-5c4cada97064 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:05.436452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 553/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:05 2022] GET /identity/v3/roles/6385a2f348c0451081ccf442289790ed => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:05.443105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf96b-de1e-440b-89e8-fa1f31fd0d7a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:05.541038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:05.555864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf96b-de1e-440b-89e8-fa1f31fd0d7a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:05.595636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71101ce1-4fbc-4853-88d4-99a261adf80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:05.596287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71101ce1-4fbc-4853-88d4-99a261adf80c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:05.596582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71101ce1-4fbc-4853-88d4-99a261adf80c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:05.596865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71101ce1-4fbc-4853-88d4-99a261adf80c None admin] PATH_INFO: `/v3/users/70ee3ab6faa64aaeb0d32ecbef087dea` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:05.613000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71101ce1-4fbc-4853-88d4-99a261adf80c None admin] RBAC: Authorizing `identity:get_user(user_id=70ee3ab6faa64aaeb0d32ecbef087dea)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:05.614472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71101ce1-4fbc-4853-88d4-99a261adf80c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:05.616221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 561/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:05 2022] GET /identity/v3/users/70ee3ab6faa64aaeb0d32ecbef087dea => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:05.622484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674c0e3-5c7d-4e0c-a86b-5c4cada97064 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:05.708121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:05.736323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674c0e3-5c7d-4e0c-a86b-5c4cada97064 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:05.775476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2602e8-4616-4f62-a8a0-d681979d4111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:05.776091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2602e8-4616-4f62-a8a0-d681979d4111 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:05.776368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2602e8-4616-4f62-a8a0-d681979d4111 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:05.776672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2602e8-4616-4f62-a8a0-d681979d4111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:05.853755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2602e8-4616-4f62-a8a0-d681979d4111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:05.855430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2602e8-4616-4f62-a8a0-d681979d4111 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:05.941404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:05.974347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 554/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:19:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:19:05.980978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71101ce1-4fbc-4853-88d4-99a261adf80c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:06.099601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71101ce1-4fbc-4853-88d4-99a261adf80c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:06.139310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267757f-b338-47fa-9609-ef906ba9af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:06.140001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267757f-b338-47fa-9609-ef906ba9af3e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:06.140258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267757f-b338-47fa-9609-ef906ba9af3e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:06.140640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267757f-b338-47fa-9609-ef906ba9af3e None admin] PATH_INFO: `/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:06.141886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267757f-b338-47fa-9609-ef906ba9af3e None admin] RBAC: Authorizing `identity:get_project(project_id=3b61561d5e154967a3d6dba1a8c0d6a6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:06.143391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267757f-b338-47fa-9609-ef906ba9af3e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:06.145133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 562/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:05 2022] GET /identity/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:06.155645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2602e8-4616-4f62-a8a0-d681979d4111 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:06.290033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2602e8-4616-4f62-a8a0-d681979d4111 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:06.356556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f416-d1d8-49b5-a375-025b041e11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:06.357616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f416-d1d8-49b5-a375-025b041e11dc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:06.358106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f416-d1d8-49b5-a375-025b041e11dc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:06.358589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f416-d1d8-49b5-a375-025b041e11dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:06.360334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84f416-d1d8-49b5-a375-025b041e11dc None admin] RBAC: Adding query filter params (role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=3b61561d5e154967a3d6dba1a8c0d6a6, user.id=70ee3ab6faa64aaeb0d32ecbef087dea) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:06.360931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84f416-d1d8-49b5-a375-025b041e11dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:06.363757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84f416-d1d8-49b5-a375-025b041e11dc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:06.374567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 555/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:19:06 2022] GET /identity/v3/role_assignments?user.id=70ee3ab6faa64aaeb0d32ecbef087dea&scope.project.id=3b61561d5e154967a3d6dba1a8c0d6a6&role.id=6385a2f348c0451081ccf442289790ed => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:08.594259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9d7e-2062-44d5-94e6-cd0bd73aaaa7 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:08.594858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9d7e-2062-44d5-94e6-cd0bd73aaaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:08.594858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9d7e-2062-44d5-94e6-cd0bd73aaaa7 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:08.596342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 563/1118] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:08.602431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d95a-8409-48de-ad02-3464493bca85 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:08.602996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d95a-8409-48de-ad02-3464493bca85 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:08.602996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d95a-8409-48de-ad02-3464493bca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:08.624292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a3e7d95a-8409-48de-ad02-3464493bca85 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:08.625631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a3e7d95a-8409-48de-ad02-3464493bca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:08.661808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:08.706456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 556/1119] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:08.978447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b9d7e-2062-44d5-94e6-cd0bd73aaaa7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:08.997320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:09.102377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b9d7e-2062-44d5-94e6-cd0bd73aaaa7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:09.141714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825db77c-72e6-44e4-85b4-59d78ab94bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:09.142358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825db77c-72e6-44e4-85b4-59d78ab94bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:09.142634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825db77c-72e6-44e4-85b4-59d78ab94bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:09.142903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825db77c-72e6-44e4-85b4-59d78ab94bc2 None admin] PATH_INFO: `/v3/roles/6385a2f348c0451081ccf442289790ed` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:09.144429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825db77c-72e6-44e4-85b4-59d78ab94bc2 None admin] RBAC: Authorizing `identity:get_role(role_id=6385a2f348c0451081ccf442289790ed)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:09.145866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825db77c-72e6-44e4-85b4-59d78ab94bc2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:09.147289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 564/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:08 2022] GET /identity/v3/roles/6385a2f348c0451081ccf442289790ed => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:09.153995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d95a-8409-48de-ad02-3464493bca85 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:09.282307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d95a-8409-48de-ad02-3464493bca85 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:09.323595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20d38e-45e4-4acf-b005-b163c0e72e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:09.324261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20d38e-45e4-4acf-b005-b163c0e72e82 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:09.324579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20d38e-45e4-4acf-b005-b163c0e72e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:09.324855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20d38e-45e4-4acf-b005-b163c0e72e82 None admin] PATH_INFO: `/v3/users/70ee3ab6faa64aaeb0d32ecbef087dea` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:09.326078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20d38e-45e4-4acf-b005-b163c0e72e82 None admin] RBAC: Authorizing `identity:get_user(user_id=70ee3ab6faa64aaeb0d32ecbef087dea)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:09.327626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20d38e-45e4-4acf-b005-b163c0e72e82 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:09.329509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 557/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:09 2022] GET /identity/v3/users/70ee3ab6faa64aaeb0d32ecbef087dea => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:09.336018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825db77c-72e6-44e4-85b4-59d78ab94bc2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:09.451573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:09.487135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825db77c-72e6-44e4-85b4-59d78ab94bc2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:09.554870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb637a-f22d-4d3e-ab51-826b2dd1d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:09.555873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb637a-f22d-4d3e-ab51-826b2dd1d615 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:09.556335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb637a-f22d-4d3e-ab51-826b2dd1d615 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:09.556881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb637a-f22d-4d3e-ab51-826b2dd1d615 None admin] PATH_INFO: `/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:09.559032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb637a-f22d-4d3e-ab51-826b2dd1d615 None admin] RBAC: Authorizing `identity:get_project(project_id=3b61561d5e154967a3d6dba1a8c0d6a6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:09.561835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb637a-f22d-4d3e-ab51-826b2dd1d615 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:09.565173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 565/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:09 2022] GET /identity/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6 => generated 311 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:09.574682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20d38e-45e4-4acf-b005-b163c0e72e82 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:09.617860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:09.699543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20d38e-45e4-4acf-b005-b163c0e72e82 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:09.743752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85212-d562-48b8-a139-ee7cf25d4715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:09.744460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85212-d562-48b8-a139-ee7cf25d4715 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:09.744757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85212-d562-48b8-a139-ee7cf25d4715 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:09.745032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85212-d562-48b8-a139-ee7cf25d4715 None admin] PATH_INFO: `/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6/users/70ee3ab6faa64aaeb0d32ecbef087dea/roles/6385a2f348c0451081ccf442289790ed` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:09.747510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed85212-d562-48b8-a139-ee7cf25d4715 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b61561d5e154967a3d6dba1a8c0d6a6, user_id=70ee3ab6faa64aaeb0d32ecbef087dea, role_id=6385a2f348c0451081ccf442289790ed)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:09.749055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed85212-d562-48b8-a139-ee7cf25d4715 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:09.766418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 558/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:19:09 2022] PUT /identity/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6/users/70ee3ab6faa64aaeb0d32ecbef087dea/roles/6385a2f348c0451081ccf442289790ed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:19:12.031743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe2b8-f2c6-4ca3-853a-cae2ab67e518 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:12.032483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe2b8-f2c6-4ca3-853a-cae2ab67e518 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:12.032842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe2b8-f2c6-4ca3-853a-cae2ab67e518 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:12.035334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 566/1124] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:12.044196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbf42-6d62-4b9d-8902-a6adcaa75ad2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:12.044814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbf42-6d62-4b9d-8902-a6adcaa75ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:12.044814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbf42-6d62-4b9d-8902-a6adcaa75ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:12.068566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-83cbbf42-6d62-4b9d-8902-a6adcaa75ad2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:12.069972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-83cbbf42-6d62-4b9d-8902-a6adcaa75ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:12.152718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 559/1125] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:12.457252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe2b8-f2c6-4ca3-853a-cae2ab67e518 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:12.582950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe2b8-f2c6-4ca3-853a-cae2ab67e518 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:12.625396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d96007-8f3f-4abf-8ff1-9936b4e3c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:12.626122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d96007-8f3f-4abf-8ff1-9936b4e3c03b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:12.626448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d96007-8f3f-4abf-8ff1-9936b4e3c03b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:12.626767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d96007-8f3f-4abf-8ff1-9936b4e3c03b None admin] PATH_INFO: `/v3/roles/6385a2f348c0451081ccf442289790ed` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:12.628435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d96007-8f3f-4abf-8ff1-9936b4e3c03b None admin] RBAC: Authorizing `identity:get_role(role_id=6385a2f348c0451081ccf442289790ed)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:12.629947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d96007-8f3f-4abf-8ff1-9936b4e3c03b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:12.631409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 567/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:12 2022] GET /identity/v3/roles/6385a2f348c0451081ccf442289790ed => generated 223 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:12.637876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbbf42-6d62-4b9d-8902-a6adcaa75ad2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:12.671979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:12.762496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbbf42-6d62-4b9d-8902-a6adcaa75ad2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:12.802855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3ac48-5025-4bad-9d50-a5747bbdb3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:12.803592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ac48-5025-4bad-9d50-a5747bbdb3dd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:12.803922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ac48-5025-4bad-9d50-a5747bbdb3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:12.804242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3ac48-5025-4bad-9d50-a5747bbdb3dd None admin] PATH_INFO: `/v3/users/70ee3ab6faa64aaeb0d32ecbef087dea` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:12.805580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3ac48-5025-4bad-9d50-a5747bbdb3dd None admin] RBAC: Authorizing `identity:get_user(user_id=70ee3ab6faa64aaeb0d32ecbef087dea)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:12.807112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3ac48-5025-4bad-9d50-a5747bbdb3dd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:12.808876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 560/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:12 2022] GET /identity/v3/users/70ee3ab6faa64aaeb0d32ecbef087dea => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:12.816116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d96007-8f3f-4abf-8ff1-9936b4e3c03b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:12.853002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:13.018312 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d96007-8f3f-4abf-8ff1-9936b4e3c03b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:13.066138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dca21-ac84-43d8-96bc-4c9a42e16aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:13.066845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dca21-ac84-43d8-96bc-4c9a42e16aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:13.067113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dca21-ac84-43d8-96bc-4c9a42e16aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:13.067423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dca21-ac84-43d8-96bc-4c9a42e16aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:13.152542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dca21-ac84-43d8-96bc-4c9a42e16aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:13.154047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dca21-ac84-43d8-96bc-4c9a42e16aa5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:13.176868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:13.279053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 568/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:19:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:19:13.285818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3ac48-5025-4bad-9d50-a5747bbdb3dd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:13.397256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:13.406471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3ac48-5025-4bad-9d50-a5747bbdb3dd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:13.449711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6c792-ffb5-449b-bb46-d7d6a983d93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:13.450411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6c792-ffb5-449b-bb46-d7d6a983d93f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:13.450694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6c792-ffb5-449b-bb46-d7d6a983d93f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:13.450969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6c792-ffb5-449b-bb46-d7d6a983d93f None admin] PATH_INFO: `/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:13.452596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6c792-ffb5-449b-bb46-d7d6a983d93f None admin] RBAC: Authorizing `identity:get_project(project_id=3b61561d5e154967a3d6dba1a8c0d6a6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:13.454142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6c792-ffb5-449b-bb46-d7d6a983d93f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:13.455899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 561/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:13 2022] GET /identity/v3/projects/3b61561d5e154967a3d6dba1a8c0d6a6 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:19:13.462731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dca21-ac84-43d8-96bc-4c9a42e16aa5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:13.580055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dca21-ac84-43d8-96bc-4c9a42e16aa5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:13.601982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:13.623693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79d26f-f482-467f-af98-ddef5fdadff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:13.624891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d26f-f482-467f-af98-ddef5fdadff0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:13.625340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d26f-f482-467f-af98-ddef5fdadff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:13.625619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d26f-f482-467f-af98-ddef5fdadff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:13.626373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79d26f-f482-467f-af98-ddef5fdadff0 None admin] RBAC: Adding query filter params (role.id=6385a2f348c0451081ccf442289790ed, scope.project.id=3b61561d5e154967a3d6dba1a8c0d6a6, user.id=70ee3ab6faa64aaeb0d32ecbef087dea) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:13.626682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79d26f-f482-467f-af98-ddef5fdadff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:13.628164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79d26f-f482-467f-af98-ddef5fdadff0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:13.635305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 569/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:19:13 2022] GET /identity/v3/role_assignments?user.id=70ee3ab6faa64aaeb0d32ecbef087dea&scope.project.id=3b61561d5e154967a3d6dba1a8c0d6a6&role.id=6385a2f348c0451081ccf442289790ed => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:16.089888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212484a9-17f7-49eb-8f96-9a57bfd2c1d5 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:16.090571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212484a9-17f7-49eb-8f96-9a57bfd2c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:16.090571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212484a9-17f7-49eb-8f96-9a57bfd2c1d5 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:16.091802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 562/1131] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:19:16.098875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c850fb-1f65-47c5-a1fc-c2f4f7cb9f5b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:16.099487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c850fb-1f65-47c5-a1fc-c2f4f7cb9f5b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:16.099487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c850fb-1f65-47c5-a1fc-c2f4f7cb9f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:16.119897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-77c850fb-1f65-47c5-a1fc-c2f4f7cb9f5b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:16.121152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-77c850fb-1f65-47c5-a1fc-c2f4f7cb9f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:16.200111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 570/1132] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:16.472427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212484a9-17f7-49eb-8f96-9a57bfd2c1d5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:16.599125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212484a9-17f7-49eb-8f96-9a57bfd2c1d5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:16.639426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85928899-9e19-4f9f-9215-83a37ad6176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:16.640146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85928899-9e19-4f9f-9215-83a37ad6176a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:16.640501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85928899-9e19-4f9f-9215-83a37ad6176a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:16.640797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85928899-9e19-4f9f-9215-83a37ad6176a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:16.642315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85928899-9e19-4f9f-9215-83a37ad6176a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:16.643859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85928899-9e19-4f9f-9215-83a37ad6176a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:16.645637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 563/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:19:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:16.652783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c850fb-1f65-47c5-a1fc-c2f4f7cb9f5b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:16.767967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c850fb-1f65-47c5-a1fc-c2f4f7cb9f5b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:16.783895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:16.808839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf1187-c216-407e-b291-e6bea9c2751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:16.809528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf1187-c216-407e-b291-e6bea9c2751a None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:16.809848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf1187-c216-407e-b291-e6bea9c2751a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:16.810157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf1187-c216-407e-b291-e6bea9c2751a None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:16.810862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf1187-c216-407e-b291-e6bea9c2751a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:16.812435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf1187-c216-407e-b291-e6bea9c2751a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:16.845643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 571/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:19:16 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:19:19.176094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4eb1-e359-4e3c-9add-1d14713a6be3 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:19.176815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4eb1-e359-4e3c-9add-1d14713a6be3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:19.176815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4eb1-e359-4e3c-9add-1d14713a6be3 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:19.178147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 564/1135] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:19.187834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b3f0-7fa4-4bf9-839e-25c50d830ed4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:19.188451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b3f0-7fa4-4bf9-839e-25c50d830ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:19.188845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b3f0-7fa4-4bf9-839e-25c50d830ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:19.220634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0a08b3f0-7fa4-4bf9-839e-25c50d830ed4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:19.222602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a08b3f0-7fa4-4bf9-839e-25c50d830ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:19.348712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 572/1136] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:19.830836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4eb1-e359-4e3c-9add-1d14713a6be3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:19.870392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:19.961669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4eb1-e359-4e3c-9add-1d14713a6be3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:20.007173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61213-1b1e-4b6b-8a37-1c23a1901bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:20.008193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61213-1b1e-4b6b-8a37-1c23a1901bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:20.008674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61213-1b1e-4b6b-8a37-1c23a1901bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:20.009154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61213-1b1e-4b6b-8a37-1c23a1901bc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:20.011150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61213-1b1e-4b6b-8a37-1c23a1901bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:20.013453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61213-1b1e-4b6b-8a37-1c23a1901bc5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:20.015693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 565/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:19:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:20.025604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08b3f0-7fa4-4bf9-839e-25c50d830ed4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:20.144428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:20.153747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08b3f0-7fa4-4bf9-839e-25c50d830ed4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:20.194726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fab2d8-b157-45f0-87f3-3e997907aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:20.195444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab2d8-b157-45f0-87f3-3e997907aacc None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:20.195601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab2d8-b157-45f0-87f3-3e997907aacc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:20.195878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab2d8-b157-45f0-87f3-3e997907aacc None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:20.196569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fab2d8-b157-45f0-87f3-3e997907aacc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:20.198053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fab2d8-b157-45f0-87f3-3e997907aacc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:20.222887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 573/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:19:20 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:19:24.085494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32edde-3885-41b1-9e4c-fc6af6d41696 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:24.086151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32edde-3885-41b1-9e4c-fc6af6d41696 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:24.086151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32edde-3885-41b1-9e4c-fc6af6d41696 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:24.087505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 566/1139] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:24.094846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234bae1-e244-4ecd-8368-b32cbe4b7918 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:24.095492 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234bae1-e244-4ecd-8368-b32cbe4b7918 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:24.095742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234bae1-e244-4ecd-8368-b32cbe4b7918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:24.120245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3234bae1-e244-4ecd-8368-b32cbe4b7918 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:24.121552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3234bae1-e244-4ecd-8368-b32cbe4b7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:24.201362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 574/1140] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:24.472878 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32edde-3885-41b1-9e4c-fc6af6d41696 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:24.591943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:24.598177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32edde-3885-41b1-9e4c-fc6af6d41696 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:24.638038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b256-de9b-4921-8668-5b5b93d138d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:24.638695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b256-de9b-4921-8668-5b5b93d138d0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:24.638975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b256-de9b-4921-8668-5b5b93d138d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:24.639249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b256-de9b-4921-8668-5b5b93d138d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:24.652459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0b256-de9b-4921-8668-5b5b93d138d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-73b0b256-de9b-4921-8668-5b5b93d138d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:19:24.658092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:19:24.659858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:19:24.661735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 567/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:19:24.667657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234bae1-e244-4ecd-8368-b32cbe4b7918 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:24.770847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:24.797239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234bae1-e244-4ecd-8368-b32cbe4b7918 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:24.841113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:24.841760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:24.842036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:24.842306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:24.843277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:24.843749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:24.845498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:24.855867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 575/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:24.865425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b256-de9b-4921-8668-5b5b93d138d0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:24.982573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b256-de9b-4921-8668-5b5b93d138d0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:25.022050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cbc62-5b2b-4cc7-b860-d0ff68048877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:25.022617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cbc62-5b2b-4cc7-b860-d0ff68048877 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:25.022897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cbc62-5b2b-4cc7-b860-d0ff68048877 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:25.023512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cbc62-5b2b-4cc7-b860-d0ff68048877 None admin] PATH_INFO: `/v3/users/19769556c65b47d691cde50caa9076de` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:25.039857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cbc62-5b2b-4cc7-b860-d0ff68048877 None admin] RBAC: Authorizing `identity:get_user(user_id=19769556c65b47d691cde50caa9076de)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:25.041394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cbc62-5b2b-4cc7-b860-d0ff68048877 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:25.043184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 568/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:24 2022] GET /identity/v3/users/19769556c65b47d691cde50caa9076de => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:25.050756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:25.177317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a879928-f1cb-4288-b74a-e262b15c2e6f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:25.218850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b26b-f33e-4e17-a069-56eecdbb4084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:25.219464 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b26b-f33e-4e17-a069-56eecdbb4084 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:25.219730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b26b-f33e-4e17-a069-56eecdbb4084 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:25.220012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b26b-f33e-4e17-a069-56eecdbb4084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:25.234621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:25.301997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b26b-f33e-4e17-a069-56eecdbb4084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:25.303412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b26b-f33e-4e17-a069-56eecdbb4084 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:25.440676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 576/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:19:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:19:25.448506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cbc62-5b2b-4cc7-b860-d0ff68048877 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:25.486142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:25.600173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cbc62-5b2b-4cc7-b860-d0ff68048877 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:25.661271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e894ca-171e-450d-8b94-42c9a29709bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:25.662229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e894ca-171e-450d-8b94-42c9a29709bb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:25.662656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e894ca-171e-450d-8b94-42c9a29709bb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:25.663111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e894ca-171e-450d-8b94-42c9a29709bb None admin] PATH_INFO: `/v3/projects/2bb1cc99a19749a7b0448790899d9daf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:25.664971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e894ca-171e-450d-8b94-42c9a29709bb None admin] RBAC: Authorizing `identity:get_project(project_id=2bb1cc99a19749a7b0448790899d9daf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:25.667489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e894ca-171e-450d-8b94-42c9a29709bb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:25.670284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 569/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:25 2022] GET /identity/v3/projects/2bb1cc99a19749a7b0448790899d9daf => generated 311 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:19:25.679740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b26b-f33e-4e17-a069-56eecdbb4084 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:25.742461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:25.813026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b26b-f33e-4e17-a069-56eecdbb4084 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:25.863993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cbce0-7d4c-485d-adea-6d0b6f9ea232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:25.864550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cbce0-7d4c-485d-adea-6d0b6f9ea232 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:25.864827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cbce0-7d4c-485d-adea-6d0b6f9ea232 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:25.865092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cbce0-7d4c-485d-adea-6d0b6f9ea232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:25.865823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cbce0-7d4c-485d-adea-6d0b6f9ea232 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=2bb1cc99a19749a7b0448790899d9daf, user.id=19769556c65b47d691cde50caa9076de) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:25.866126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cbce0-7d4c-485d-adea-6d0b6f9ea232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:25.867603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cbce0-7d4c-485d-adea-6d0b6f9ea232 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:25.874006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 577/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:19:25 2022] GET /identity/v3/role_assignments?user.id=19769556c65b47d691cde50caa9076de&scope.project.id=2bb1cc99a19749a7b0448790899d9daf&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:28.226646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c4a7-1e04-4cd6-93e6-c0d2b3c5c384 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:28.227404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c4a7-1e04-4cd6-93e6-c0d2b3c5c384 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:28.227404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c4a7-1e04-4cd6-93e6-c0d2b3c5c384 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:28.228623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 570/1147] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:19:28.235864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac1e1-1661-469e-8cf8-a19a37bec750 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:28.236652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac1e1-1661-469e-8cf8-a19a37bec750 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:28.236866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac1e1-1661-469e-8cf8-a19a37bec750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:28.258689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-120ac1e1-1661-469e-8cf8-a19a37bec750 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:28.260233 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-120ac1e1-1661-469e-8cf8-a19a37bec750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:28.405463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 578/1148] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:28.739565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2c4a7-1e04-4cd6-93e6-c0d2b3c5c384 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:28.877730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:28.904672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2c4a7-1e04-4cd6-93e6-c0d2b3c5c384 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:28.958653 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f588cd-07e3-4f0e-a493-be9559644101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:28.959758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f588cd-07e3-4f0e-a493-be9559644101 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:28.960251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f588cd-07e3-4f0e-a493-be9559644101 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:28.960786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f588cd-07e3-4f0e-a493-be9559644101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:28.979494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f588cd-07e3-4f0e-a493-be9559644101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-75f588cd-07e3-4f0e-a493-be9559644101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:19:28.985490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:19:28.987302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:19:28.988586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 571/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:19:28.993479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac1e1-1661-469e-8cf8-a19a37bec750 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:29.049406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:29.164629 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac1e1-1661-469e-8cf8-a19a37bec750 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:29.226112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:29.226823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:29.227169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:29.227548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:29.228368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:29.228741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:29.230186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:29.240969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 579/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:29.251703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f588cd-07e3-4f0e-a493-be9559644101 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:29.413880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f588cd-07e3-4f0e-a493-be9559644101 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:29.465505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498061ef-fefd-4b26-977a-8a405d13abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:29.466146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498061ef-fefd-4b26-977a-8a405d13abf4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:29.466544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498061ef-fefd-4b26-977a-8a405d13abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:29.466879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498061ef-fefd-4b26-977a-8a405d13abf4 None admin] PATH_INFO: `/v3/users/19769556c65b47d691cde50caa9076de` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:29.468302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498061ef-fefd-4b26-977a-8a405d13abf4 None admin] RBAC: Authorizing `identity:get_user(user_id=19769556c65b47d691cde50caa9076de)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:29.470139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498061ef-fefd-4b26-977a-8a405d13abf4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:29.471979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 572/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:29 2022] GET /identity/v3/users/19769556c65b47d691cde50caa9076de => generated 286 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:29.478394 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:29.618237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:29.622413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5b4ba-0ba3-4bf0-9964-6286c24372eb None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:29.669810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7004f-ab63-4d3c-b833-0062b245a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:29.670457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7004f-ab63-4d3c-b833-0062b245a241 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:29.670958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7004f-ab63-4d3c-b833-0062b245a241 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:29.671233 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7004f-ab63-4d3c-b833-0062b245a241 None admin] PATH_INFO: `/v3/projects/2bb1cc99a19749a7b0448790899d9daf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:29.672469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7004f-ab63-4d3c-b833-0062b245a241 None admin] RBAC: Authorizing `identity:get_project(project_id=2bb1cc99a19749a7b0448790899d9daf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:29.673952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7004f-ab63-4d3c-b833-0062b245a241 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:29.675725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 580/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:29 2022] GET /identity/v3/projects/2bb1cc99a19749a7b0448790899d9daf => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:29.682620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498061ef-fefd-4b26-977a-8a405d13abf4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:29.699663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:29.805562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498061ef-fefd-4b26-977a-8a405d13abf4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:29.847540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cb504-ec0a-4f6b-a1d7-28bed75ab649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:29.848285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb504-ec0a-4f6b-a1d7-28bed75ab649 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:29.848729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb504-ec0a-4f6b-a1d7-28bed75ab649 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:29.849024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb504-ec0a-4f6b-a1d7-28bed75ab649 None admin] PATH_INFO: `/v3/projects/2bb1cc99a19749a7b0448790899d9daf/users/19769556c65b47d691cde50caa9076de/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:29.851313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cb504-ec0a-4f6b-a1d7-28bed75ab649 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bb1cc99a19749a7b0448790899d9daf, user_id=19769556c65b47d691cde50caa9076de, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:29.853063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cb504-ec0a-4f6b-a1d7-28bed75ab649 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:29.870018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 573/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:19:29 2022] PUT /identity/v3/projects/2bb1cc99a19749a7b0448790899d9daf/users/19769556c65b47d691cde50caa9076de/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:19:32.217068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ed64-aed1-41f9-a364-3da8012d9bbb None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:32.217881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ed64-aed1-41f9-a364-3da8012d9bbb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:32.218387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ed64-aed1-41f9-a364-3da8012d9bbb None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:32.220058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 581/1154] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:32.226928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c79c2-1112-4d80-af95-8a985a425987 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:32.227789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c79c2-1112-4d80-af95-8a985a425987 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:32.227789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c79c2-1112-4d80-af95-8a985a425987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:32.249169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1d7c79c2-1112-4d80-af95-8a985a425987 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:32.250525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1d7c79c2-1112-4d80-af95-8a985a425987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:32.330056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 574/1155] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:32.603013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70ed64-aed1-41f9-a364-3da8012d9bbb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:32.722719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70ed64-aed1-41f9-a364-3da8012d9bbb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:32.763115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08168-8b6b-4b68-a6a7-4f2d0c44f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:32.763801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08168-8b6b-4b68-a6a7-4f2d0c44f373 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:32.764075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08168-8b6b-4b68-a6a7-4f2d0c44f373 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:32.764431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08168-8b6b-4b68-a6a7-4f2d0c44f373 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:32.778025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af08168-8b6b-4b68-a6a7-4f2d0c44f373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-6af08168-8b6b-4b68-a6a7-4f2d0c44f373 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:19:32.783402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:19:32.785166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:19:32.786834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 582/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:19:32.792740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c79c2-1112-4d80-af95-8a985a425987 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:32.795166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:32.913880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c79c2-1112-4d80-af95-8a985a425987 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:32.954066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:32.954758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:32.955079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:32.955396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:32.956133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:32.956511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:32.957999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:32.968024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 575/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:32.974475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08168-8b6b-4b68-a6a7-4f2d0c44f373 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:33.014169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:33.110437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08168-8b6b-4b68-a6a7-4f2d0c44f373 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:33.149078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596c328-57b5-46e3-b839-9b54e036a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:33.149827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596c328-57b5-46e3-b839-9b54e036a247 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:33.150153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596c328-57b5-46e3-b839-9b54e036a247 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:33.150435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596c328-57b5-46e3-b839-9b54e036a247 None admin] PATH_INFO: `/v3/users/19769556c65b47d691cde50caa9076de` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:33.151734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596c328-57b5-46e3-b839-9b54e036a247 None admin] RBAC: Authorizing `identity:get_user(user_id=19769556c65b47d691cde50caa9076de)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:33.153326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596c328-57b5-46e3-b839-9b54e036a247 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:33.155043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 583/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:32 2022] GET /identity/v3/users/19769556c65b47d691cde50caa9076de => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:33.161479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:33.233503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:33.278523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d3cef-6b48-4470-bff8-f9285e5e1e79 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:33.319390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c836a-7363-4ae1-b616-040246dc23b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:33.320134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c836a-7363-4ae1-b616-040246dc23b1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:33.320541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c836a-7363-4ae1-b616-040246dc23b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:33.320874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c836a-7363-4ae1-b616-040246dc23b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:33.414820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c836a-7363-4ae1-b616-040246dc23b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:33.416344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c836a-7363-4ae1-b616-040246dc23b1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:33.488753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:33.537485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 576/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:19:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:19:33.544287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596c328-57b5-46e3-b839-9b54e036a247 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:33.661637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:33.670101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596c328-57b5-46e3-b839-9b54e036a247 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:33.713252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498255b-14e6-4540-b3bc-c1a34285c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:33.713916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498255b-14e6-4540-b3bc-c1a34285c73a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:33.714190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498255b-14e6-4540-b3bc-c1a34285c73a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:33.714459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498255b-14e6-4540-b3bc-c1a34285c73a None admin] PATH_INFO: `/v3/projects/2bb1cc99a19749a7b0448790899d9daf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:33.715721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498255b-14e6-4540-b3bc-c1a34285c73a None admin] RBAC: Authorizing `identity:get_project(project_id=2bb1cc99a19749a7b0448790899d9daf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:33.717259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498255b-14e6-4540-b3bc-c1a34285c73a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:33.719595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 584/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:33 2022] GET /identity/v3/projects/2bb1cc99a19749a7b0448790899d9daf => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:33.726611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c836a-7363-4ae1-b616-040246dc23b1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:33.848091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c836a-7363-4ae1-b616-040246dc23b1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:33.889511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb3959-0761-44b1-8e6a-2647ac422d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:33.890318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3959-0761-44b1-8e6a-2647ac422d5c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:33.890489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3959-0761-44b1-8e6a-2647ac422d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:33.890815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3959-0761-44b1-8e6a-2647ac422d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:33.891632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb3959-0761-44b1-8e6a-2647ac422d5c None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=2bb1cc99a19749a7b0448790899d9daf, user.id=19769556c65b47d691cde50caa9076de) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:33.891982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb3959-0761-44b1-8e6a-2647ac422d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:33.893550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb3959-0761-44b1-8e6a-2647ac422d5c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:33.900819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 577/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:19:33 2022] GET /identity/v3/role_assignments?user.id=19769556c65b47d691cde50caa9076de&scope.project.id=2bb1cc99a19749a7b0448790899d9daf&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:36.243419 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e5f6-e214-430d-8b6d-da6cb0957f9d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:36.243986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e5f6-e214-430d-8b6d-da6cb0957f9d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:36.243986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e5f6-e214-430d-8b6d-da6cb0957f9d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:36.245576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 585/1162] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:36.252578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6b94-7503-46d6-beee-10cd7c670aa1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:36.253205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6b94-7503-46d6-beee-10cd7c670aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:36.253205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6b94-7503-46d6-beee-10cd7c670aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:36.274730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b90e6b94-7503-46d6-beee-10cd7c670aa1 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:36.276014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b90e6b94-7503-46d6-beee-10cd7c670aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:36.305341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:36.357478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 578/1163] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:19:36.635640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0e5f6-e214-430d-8b6d-da6cb0957f9d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:36.767840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0e5f6-e214-430d-8b6d-da6cb0957f9d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:36.809234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850d3fd-2fce-4e2d-be2d-3d3dec0f2b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:36.809860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850d3fd-2fce-4e2d-be2d-3d3dec0f2b83 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:36.810133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850d3fd-2fce-4e2d-be2d-3d3dec0f2b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:36.810398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850d3fd-2fce-4e2d-be2d-3d3dec0f2b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:36.847092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:36.891056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850d3fd-2fce-4e2d-be2d-3d3dec0f2b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:36.892746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850d3fd-2fce-4e2d-be2d-3d3dec0f2b83 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:37.006067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 586/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:19:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:19:37.012439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e6b94-7503-46d6-beee-10cd7c670aa1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:37.129469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e6b94-7503-46d6-beee-10cd7c670aa1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:37.170415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8beaf-a2b4-4a17-b949-170a76c8f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:37.171262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8beaf-a2b4-4a17-b949-170a76c8f0ef None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:37.171540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8beaf-a2b4-4a17-b949-170a76c8f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:37.171828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8beaf-a2b4-4a17-b949-170a76c8f0ef None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:37.179866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8beaf-a2b4-4a17-b949-170a76c8f0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:37.181477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8beaf-a2b4-4a17-b949-170a76c8f0ef None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d6e8beaf-a2b4-4a17-b949-170a76c8f0ef None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:19:37.194515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:19:37.196530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:19:37.198216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 579/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:19:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:19:37.205664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850d3fd-2fce-4e2d-be2d-3d3dec0f2b83 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:37.281035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:37.326940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850d3fd-2fce-4e2d-be2d-3d3dec0f2b83 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:37.367420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455c41-5e7d-4964-bb05-43ac916521b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:37.368034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455c41-5e7d-4964-bb05-43ac916521b4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:37.368309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455c41-5e7d-4964-bb05-43ac916521b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:37.368604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455c41-5e7d-4964-bb05-43ac916521b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:37.369263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af455c41-5e7d-4964-bb05-43ac916521b4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:37.369562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af455c41-5e7d-4964-bb05-43ac916521b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:37.370964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af455c41-5e7d-4964-bb05-43ac916521b4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:37.379994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 587/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Tue Sep 13 12:19:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:39.672585 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41479d-8af5-41cf-828e-8910d90e82d2 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:39.673426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41479d-8af5-41cf-828e-8910d90e82d2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:39.673426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41479d-8af5-41cf-828e-8910d90e82d2 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:39.675108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 580/1167] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:39.681815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb94a8f-5554-4311-b20a-aa6a8b40ceee None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:39.682438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb94a8f-5554-4311-b20a-aa6a8b40ceee None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:39.682438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb94a8f-5554-4311-b20a-aa6a8b40ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:39.703725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-edb94a8f-5554-4311-b20a-aa6a8b40ceee None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:39.705008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-edb94a8f-5554-4311-b20a-aa6a8b40ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:39.810423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 588/1168] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:40.306885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41479d-8af5-41cf-828e-8910d90e82d2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:40.333424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:40.440702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41479d-8af5-41cf-828e-8910d90e82d2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:40.484101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ee816-d085-4b60-a9c5-0d48a6c7b110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:40.484771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ee816-d085-4b60-a9c5-0d48a6c7b110 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:40.485051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ee816-d085-4b60-a9c5-0d48a6c7b110 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:40.485326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ee816-d085-4b60-a9c5-0d48a6c7b110 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:40.486032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ee816-d085-4b60-a9c5-0d48a6c7b110 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:40.487442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ee816-d085-4b60-a9c5-0d48a6c7b110 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:40.507362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 581/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Tue Sep 13 12:19:40 2022] POST /identity/v3/domains => generated 267 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:19:42.804504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac10b-dfc6-4b12-9ff8-c9b2ec67a955 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:42.805089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac10b-dfc6-4b12-9ff8-c9b2ec67a955 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:42.805089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ac10b-dfc6-4b12-9ff8-c9b2ec67a955 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:42.806489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 589/1170] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:19:42.813897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a386ce2-de6d-427e-b220-8c83a73f53dc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:42.814476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a386ce2-de6d-427e-b220-8c83a73f53dc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:42.814476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a386ce2-de6d-427e-b220-8c83a73f53dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:42.835768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6a386ce2-de6d-427e-b220-8c83a73f53dc None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:42.837021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6a386ce2-de6d-427e-b220-8c83a73f53dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:42.924547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 582/1171] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:43.212847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ac10b-dfc6-4b12-9ff8-c9b2ec67a955 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:43.284617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:43.341658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ac10b-dfc6-4b12-9ff8-c9b2ec67a955 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:43.383887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df54af-75ac-47da-8f05-3ce0b961e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:43.384580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df54af-75ac-47da-8f05-3ce0b961e9ed None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:43.384859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df54af-75ac-47da-8f05-3ce0b961e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:43.385123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df54af-75ac-47da-8f05-3ce0b961e9ed None admin] PATH_INFO: `/v3/domains/262ca9ff82b946ec9b3f5b79a6973047` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:43.398463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df54af-75ac-47da-8f05-3ce0b961e9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=262ca9ff82b946ec9b3f5b79a6973047)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:43.399971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df54af-75ac-47da-8f05-3ce0b961e9ed None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:43.401763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 590/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Tue Sep 13 12:19:43 2022] GET /identity/v3/domains/262ca9ff82b946ec9b3f5b79a6973047 => generated 267 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:19:43.408817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a386ce2-de6d-427e-b220-8c83a73f53dc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:43.420121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:43.532090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a386ce2-de6d-427e-b220-8c83a73f53dc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:43.576324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f00cf-f76d-4805-8c81-7b600004fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:43.577400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f00cf-f76d-4805-8c81-7b600004fc15 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:43.577879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f00cf-f76d-4805-8c81-7b600004fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:43.578358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f00cf-f76d-4805-8c81-7b600004fc15 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:43.579537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f00cf-f76d-4805-8c81-7b600004fc15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:43.582470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f00cf-f76d-4805-8c81-7b600004fc15 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:43.627949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 583/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:19:43 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:19:46.090525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c76e-f4ed-4f2b-b84b-c961b584a420 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:46.091266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c76e-f4ed-4f2b-b84b-c961b584a420 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:46.091404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c76e-f4ed-4f2b-b84b-c961b584a420 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:46.094349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 591/1174] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:46.101939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb484-c527-4415-8bc0-0fb672dbb509 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:46.102571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb484-c527-4415-8bc0-0fb672dbb509 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:46.102571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb484-c527-4415-8bc0-0fb672dbb509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:46.124680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a36cb484-c527-4415-8bc0-0fb672dbb509 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:46.125993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a36cb484-c527-4415-8bc0-0fb672dbb509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:46.214879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:46.229749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 584/1175] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:19:46.520038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c76e-f4ed-4f2b-b84b-c961b584a420 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:46.683086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c76e-f4ed-4f2b-b84b-c961b584a420 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:46.705110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:46.727728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18c74a-8eb7-4bb3-a8f4-35dc89547677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:46.728505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c74a-8eb7-4bb3-a8f4-35dc89547677 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:46.728834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c74a-8eb7-4bb3-a8f4-35dc89547677 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:46.729153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c74a-8eb7-4bb3-a8f4-35dc89547677 None admin] PATH_INFO: `/v3/domains/262ca9ff82b946ec9b3f5b79a6973047` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:46.730585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18c74a-8eb7-4bb3-a8f4-35dc89547677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=262ca9ff82b946ec9b3f5b79a6973047)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:46.732148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18c74a-8eb7-4bb3-a8f4-35dc89547677 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:46.734405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 592/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Tue Sep 13 12:19:46 2022] GET /identity/v3/domains/262ca9ff82b946ec9b3f5b79a6973047 => generated 267 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:19:46.741006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb484-c527-4415-8bc0-0fb672dbb509 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:46.861064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb484-c527-4415-8bc0-0fb672dbb509 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:46.905568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b1c7d-847a-44e9-a151-b7940a9e42cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:46.906340 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b1c7d-847a-44e9-a151-b7940a9e42cd None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:46.906709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b1c7d-847a-44e9-a151-b7940a9e42cd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:46.907074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b1c7d-847a-44e9-a151-b7940a9e42cd None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:46.907859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b1c7d-847a-44e9-a151-b7940a9e42cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:46.909514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b1c7d-847a-44e9-a151-b7940a9e42cd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:46.935170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 585/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:19:46 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:19:49.299443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fc6e-5f15-47ca-95b8-e63c580fefce None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:49.300052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fc6e-5f15-47ca-95b8-e63c580fefce None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:49.300052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fc6e-5f15-47ca-95b8-e63c580fefce None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:49.301383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 593/1178] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:19:49.307644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72acd-a678-4b7f-81cd-ee5126fa779e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:49.308231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72acd-a678-4b7f-81cd-ee5126fa779e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:49.308231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72acd-a678-4b7f-81cd-ee5126fa779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:49.329286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c3a72acd-a678-4b7f-81cd-ee5126fa779e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:49.330620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c3a72acd-a678-4b7f-81cd-ee5126fa779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:49.382772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:49.414270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 586/1179] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:49.703567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1fc6e-5f15-47ca-95b8-e63c580fefce None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:49.825030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1fc6e-5f15-47ca-95b8-e63c580fefce None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:49.867840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39527-b8be-4e9b-b0b5-81aaf648b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:49.868524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39527-b8be-4e9b-b0b5-81aaf648b639 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:49.868872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39527-b8be-4e9b-b0b5-81aaf648b639 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:49.869338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39527-b8be-4e9b-b0b5-81aaf648b639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:49.882649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39527-b8be-4e9b-b0b5-81aaf648b639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1fb39527-b8be-4e9b-b0b5-81aaf648b639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:19:49.887691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:19:49.890581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:19:49.892693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 594/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:19:49.898743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72acd-a678-4b7f-81cd-ee5126fa779e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:50.021785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72acd-a678-4b7f-81cd-ee5126fa779e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:50.061963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:50.062750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:50.063116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:50.063614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:50.064439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:50.064851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:50.066390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:50.076467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 587/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:19:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:50.086473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39527-b8be-4e9b-b0b5-81aaf648b639 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:50.175205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:50.250644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39527-b8be-4e9b-b0b5-81aaf648b639 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:50.292297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce833-97db-40d9-8aba-71e206fbc95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:50.292982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce833-97db-40d9-8aba-71e206fbc95d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:50.293259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce833-97db-40d9-8aba-71e206fbc95d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:50.293531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ce833-97db-40d9-8aba-71e206fbc95d None admin] PATH_INFO: `/v3/users/bbd31529fe604ba9a13fa332afce8122` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:50.310756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ce833-97db-40d9-8aba-71e206fbc95d None admin] RBAC: Authorizing `identity:get_user(user_id=bbd31529fe604ba9a13fa332afce8122)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:50.312753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ce833-97db-40d9-8aba-71e206fbc95d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:50.314517 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 595/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:50 2022] GET /identity/v3/users/bbd31529fe604ba9a13fa332afce8122 => generated 311 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:50.323895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:50.370794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:50.445348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469b81-7d8c-4f09-bfe9-55cd7bff9f45 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:50.492630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4b561-2b7d-4257-84cc-25c297186c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:50.493280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4b561-2b7d-4257-84cc-25c297186c6a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:50.493564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4b561-2b7d-4257-84cc-25c297186c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:50.493844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4b561-2b7d-4257-84cc-25c297186c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:50.580552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4b561-2b7d-4257-84cc-25c297186c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:50.582179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4b561-2b7d-4257-84cc-25c297186c6a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:50.630351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:50.708870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 588/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:19:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:19:50.718688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce833-97db-40d9-8aba-71e206fbc95d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:50.842522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ce833-97db-40d9-8aba-71e206fbc95d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:50.844555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:50.888125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606c3a2-b5fe-4dd4-9c7f-fa1a57d62cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:50.888739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c3a2-b5fe-4dd4-9c7f-fa1a57d62cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:50.889017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c3a2-b5fe-4dd4-9c7f-fa1a57d62cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:50.889273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c3a2-b5fe-4dd4-9c7f-fa1a57d62cb6 None admin] PATH_INFO: `/v3/projects/4ba9141b48a641f0ac5b2e2e476dbfa4` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:50.890593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606c3a2-b5fe-4dd4-9c7f-fa1a57d62cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba9141b48a641f0ac5b2e2e476dbfa4)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:50.892092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606c3a2-b5fe-4dd4-9c7f-fa1a57d62cb6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:50.893853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 596/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:50 2022] GET /identity/v3/projects/4ba9141b48a641f0ac5b2e2e476dbfa4 => generated 361 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:50.901054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4b561-2b7d-4257-84cc-25c297186c6a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:51.022686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4b561-2b7d-4257-84cc-25c297186c6a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:51.065106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e11a-34a4-4c20-aff8-0e0510d82f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:51.065846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e11a-34a4-4c20-aff8-0e0510d82f03 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:51.066178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e11a-34a4-4c20-aff8-0e0510d82f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:51.066500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e11a-34a4-4c20-aff8-0e0510d82f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:51.067298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e11a-34a4-4c20-aff8-0e0510d82f03 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=4ba9141b48a641f0ac5b2e2e476dbfa4, user.id=bbd31529fe604ba9a13fa332afce8122) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:51.067652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e11a-34a4-4c20-aff8-0e0510d82f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:51.069306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e11a-34a4-4c20-aff8-0e0510d82f03 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:51.076048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 589/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:19:50 2022] GET /identity/v3/role_assignments?user.id=bbd31529fe604ba9a13fa332afce8122&scope.project.id=4ba9141b48a641f0ac5b2e2e476dbfa4&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:53.336815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab68193-38e1-4d49-be66-2071ad1bf6c4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:53.337404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab68193-38e1-4d49-be66-2071ad1bf6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:53.337404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab68193-38e1-4d49-be66-2071ad1bf6c4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:53.338924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 597/1186] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:53.346164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33ffb-be69-429a-96ec-b35a1c5bb3ab None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:53.346787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33ffb-be69-429a-96ec-b35a1c5bb3ab None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:53.347088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad33ffb-be69-429a-96ec-b35a1c5bb3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:53.358036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:53.373594 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3ad33ffb-be69-429a-96ec-b35a1c5bb3ab None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:53.374887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3ad33ffb-be69-429a-96ec-b35a1c5bb3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:53.456415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 590/1187] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:53.822363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab68193-38e1-4d49-be66-2071ad1bf6c4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:53.975283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab68193-38e1-4d49-be66-2071ad1bf6c4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:54.037761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d931-35d4-4e83-9c8f-a5b1552b8980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:54.038815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d931-35d4-4e83-9c8f-a5b1552b8980 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:54.039278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d931-35d4-4e83-9c8f-a5b1552b8980 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:54.039754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d931-35d4-4e83-9c8f-a5b1552b8980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:54.061354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2d931-35d4-4e83-9c8f-a5b1552b8980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-29c2d931-35d4-4e83-9c8f-a5b1552b8980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:19:54.071471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:19:54.072800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:54.073791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:19:54.074708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 598/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:19:54.080334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad33ffb-be69-429a-96ec-b35a1c5bb3ab None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:54.197328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad33ffb-be69-429a-96ec-b35a1c5bb3ab None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:54.231435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:54.237765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:54.238531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:54.238901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:54.239265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:54.240035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:54.240539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:54.242722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:54.252963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 591/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:54.259732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d931-35d4-4e83-9c8f-a5b1552b8980 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:54.297970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:54.380777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d931-35d4-4e83-9c8f-a5b1552b8980 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:54.423371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80740a77-99c7-4e04-9f7f-c57c6f1f8ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:54.424026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80740a77-99c7-4e04-9f7f-c57c6f1f8ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:54.424300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80740a77-99c7-4e04-9f7f-c57c6f1f8ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:54.424598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80740a77-99c7-4e04-9f7f-c57c6f1f8ad4 None admin] PATH_INFO: `/v3/users/bbd31529fe604ba9a13fa332afce8122` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:54.425884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80740a77-99c7-4e04-9f7f-c57c6f1f8ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd31529fe604ba9a13fa332afce8122)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:54.427370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80740a77-99c7-4e04-9f7f-c57c6f1f8ad4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:54.429088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 599/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:54 2022] GET /identity/v3/users/bbd31529fe604ba9a13fa332afce8122 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:54.435660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:54.556839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a0c3f-eada-4cef-b06f-47d5c99ff330 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:54.599926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84dec1-9c49-4abb-901f-5281c5f0c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:54.600628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84dec1-9c49-4abb-901f-5281c5f0c42c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:54.600913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84dec1-9c49-4abb-901f-5281c5f0c42c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:54.601191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84dec1-9c49-4abb-901f-5281c5f0c42c None admin] PATH_INFO: `/v3/projects/4ba9141b48a641f0ac5b2e2e476dbfa4` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:54.602436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84dec1-9c49-4abb-901f-5281c5f0c42c None admin] RBAC: Authorizing `identity:get_project(project_id=4ba9141b48a641f0ac5b2e2e476dbfa4)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:54.603910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84dec1-9c49-4abb-901f-5281c5f0c42c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:54.605680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 592/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:54 2022] GET /identity/v3/projects/4ba9141b48a641f0ac5b2e2e476dbfa4 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:54.616173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80740a77-99c7-4e04-9f7f-c57c6f1f8ad4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:54.782296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:54.787355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80740a77-99c7-4e04-9f7f-c57c6f1f8ad4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:54.829602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0e619-2fde-46c1-b282-ee37b9601ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:54.830344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e619-2fde-46c1-b282-ee37b9601ced None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:54.830655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e619-2fde-46c1-b282-ee37b9601ced None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:54.830978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e619-2fde-46c1-b282-ee37b9601ced None admin] PATH_INFO: `/v3/projects/4ba9141b48a641f0ac5b2e2e476dbfa4/users/bbd31529fe604ba9a13fa332afce8122/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:54.833305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0e619-2fde-46c1-b282-ee37b9601ced None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba9141b48a641f0ac5b2e2e476dbfa4, user_id=bbd31529fe604ba9a13fa332afce8122, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:54.834855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0e619-2fde-46c1-b282-ee37b9601ced None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:54.850610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 600/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:19:54 2022] PUT /identity/v3/projects/4ba9141b48a641f0ac5b2e2e476dbfa4/users/bbd31529fe604ba9a13fa332afce8122/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:19:57.206392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44ef5-6693-4ee3-a8a0-fc967f023849 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:57.207000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44ef5-6693-4ee3-a8a0-fc967f023849 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:57.207303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44ef5-6693-4ee3-a8a0-fc967f023849 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:57.209846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 593/1193] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:19:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:19:57.216286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f8a2-68d8-4f46-9ecf-755185ffe7da None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:57.217138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f8a2-68d8-4f46-9ecf-755185ffe7da None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:57.217812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f8a2-68d8-4f46-9ecf-755185ffe7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:57.239900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9783f8a2-68d8-4f46-9ecf-755185ffe7da None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:57.241420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9783f8a2-68d8-4f46-9ecf-755185ffe7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:57.326964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 601/1194] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:19:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:19:57.606404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44ef5-6693-4ee3-a8a0-fc967f023849 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:57.687960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:57.761356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44ef5-6693-4ee3-a8a0-fc967f023849 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:57.812829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd2b3-34d9-48ba-8124-2bd95947787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:57.813500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd2b3-34d9-48ba-8124-2bd95947787d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:57.813774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd2b3-34d9-48ba-8124-2bd95947787d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:57.814046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd2b3-34d9-48ba-8124-2bd95947787d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:57.827995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dd2b3-34d9-48ba-8124-2bd95947787d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-9b6dd2b3-34d9-48ba-8124-2bd95947787d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:19:57.832884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:19:57.834890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:19:57.836953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 594/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:19:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:19:57.843241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f8a2-68d8-4f46-9ecf-755185ffe7da None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:57.956869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:57.972633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f8a2-68d8-4f46-9ecf-755185ffe7da None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:58.011040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:58.011652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:58.011925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:58.012192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:58.012897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:58.013194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:58.014717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:58.024993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 602/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:19:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:58.034743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd2b3-34d9-48ba-8124-2bd95947787d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:58.151967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd2b3-34d9-48ba-8124-2bd95947787d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:58.178083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:58.192143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995309f-6c6b-4430-b608-d44db66c31d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:58.192830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995309f-6c6b-4430-b608-d44db66c31d6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:58.193090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995309f-6c6b-4430-b608-d44db66c31d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:58.193370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995309f-6c6b-4430-b608-d44db66c31d6 None admin] PATH_INFO: `/v3/users/bbd31529fe604ba9a13fa332afce8122` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:58.194582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995309f-6c6b-4430-b608-d44db66c31d6 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd31529fe604ba9a13fa332afce8122)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:58.196057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995309f-6c6b-4430-b608-d44db66c31d6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:58.197776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 595/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Tue Sep 13 12:19:58 2022] GET /identity/v3/users/bbd31529fe604ba9a13fa332afce8122 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:19:58.204534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:58.324276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa1418-9a66-4d88-84e8-c8ab7c8dbb9d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:58.364553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f22d5-a672-4b01-a665-b1e09631aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:58.365184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f22d5-a672-4b01-a665-b1e09631aba0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:58.365455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f22d5-a672-4b01-a665-b1e09631aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:58.365724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f22d5-a672-4b01-a665-b1e09631aba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:58.390116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:58.452505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f22d5-a672-4b01-a665-b1e09631aba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:58.454086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f22d5-a672-4b01-a665-b1e09631aba0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:58.576708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 603/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:19:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:19:58.583393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995309f-6c6b-4430-b608-d44db66c31d6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:58.711578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995309f-6c6b-4430-b608-d44db66c31d6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:58.753880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4a02b-875d-4f38-8397-3a55bd707831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:58.754594 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4a02b-875d-4f38-8397-3a55bd707831 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:58.754877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4a02b-875d-4f38-8397-3a55bd707831 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:58.755149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4a02b-875d-4f38-8397-3a55bd707831 None admin] PATH_INFO: `/v3/projects/4ba9141b48a641f0ac5b2e2e476dbfa4` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:58.756363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4a02b-875d-4f38-8397-3a55bd707831 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba9141b48a641f0ac5b2e2e476dbfa4)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:58.757883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4a02b-875d-4f38-8397-3a55bd707831 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:58.759697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 596/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Tue Sep 13 12:19:58 2022] GET /identity/v3/projects/4ba9141b48a641f0ac5b2e2e476dbfa4 => generated 361 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:19:58.767476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f22d5-a672-4b01-a665-b1e09631aba0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:58.834686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:58.900710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f22d5-a672-4b01-a665-b1e09631aba0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:58.943339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d12031-d610-4fbb-bfbd-972717f6cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:58.943962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12031-d610-4fbb-bfbd-972717f6cb40 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:58.944235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12031-d610-4fbb-bfbd-972717f6cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:58.944528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12031-d610-4fbb-bfbd-972717f6cb40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:58.945276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d12031-d610-4fbb-bfbd-972717f6cb40 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=4ba9141b48a641f0ac5b2e2e476dbfa4, user.id=bbd31529fe604ba9a13fa332afce8122) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:19:58.945576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d12031-d610-4fbb-bfbd-972717f6cb40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:58.947073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d12031-d610-4fbb-bfbd-972717f6cb40 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:58.954396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 604/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:19:58 2022] GET /identity/v3/role_assignments?user.id=bbd31529fe604ba9a13fa332afce8122&scope.project.id=4ba9141b48a641f0ac5b2e2e476dbfa4&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:20:08.748871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=71 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:20:08.950980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=43 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:00.002838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3dbe-1d5a-421f-8f93-0bdb99f9bdfe None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:00.003805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3dbe-1d5a-421f-8f93-0bdb99f9bdfe None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:00.003805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3dbe-1d5a-421f-8f93-0bdb99f9bdfe None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:00.004811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 597/1201] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:00.010983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce237-13ed-4f3d-a062-7c012dac347a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:00.012047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce237-13ed-4f3d-a062-7c012dac347a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:00.012047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce237-13ed-4f3d-a062-7c012dac347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:00.033368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c92ce237-13ed-4f3d-a062-7c012dac347a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:00.034617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c92ce237-13ed-4f3d-a062-7c012dac347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:00.127646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 605/1202] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:00.477365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3dbe-1d5a-421f-8f93-0bdb99f9bdfe None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:00.709014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3dbe-1d5a-421f-8f93-0bdb99f9bdfe None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:00.781209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:00.782290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:00.782811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:00.783306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:00.805976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:00.808362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:00.836711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:00.837910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:00.838894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:00.838894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:00.838894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:00.838894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 598/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:00.849358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ce237-13ed-4f3d-a062-7c012dac347a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:01.062571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ce237-13ed-4f3d-a062-7c012dac347a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:01.112665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:01.119219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be022ef-7d11-4f11-b0b5-1e35ec92492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:01.119872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be022ef-7d11-4f11-b0b5-1e35ec92492c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:01.120142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be022ef-7d11-4f11-b0b5-1e35ec92492c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:01.120452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be022ef-7d11-4f11-b0b5-1e35ec92492c None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:01.121149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be022ef-7d11-4f11-b0b5-1e35ec92492c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:01.121472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be022ef-7d11-4f11-b0b5-1e35ec92492c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:01.123069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be022ef-7d11-4f11-b0b5-1e35ec92492c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:01.137149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 606/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:01.143901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:01.245978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:01.342638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a6819-e756-4ae5-9cd3-f89d818e96ef None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:01.394954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34ce03-1e8d-4e24-9240-95ef8dc461e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:01.396331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ce03-1e8d-4e24-9240-95ef8dc461e4 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:01.396331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ce03-1e8d-4e24-9240-95ef8dc461e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:01.396331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ce03-1e8d-4e24-9240-95ef8dc461e4 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:01.400450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34ce03-1e8d-4e24-9240-95ef8dc461e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:01.400450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34ce03-1e8d-4e24-9240-95ef8dc461e4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:01.437392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 599/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Tue Sep 13 12:21:01 2022] POST /identity/v3/users => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:21:04.165793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10571e-e4f9-44ef-9b79-28eaa620be69 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:04.166407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10571e-e4f9-44ef-9b79-28eaa620be69 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:04.166407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10571e-e4f9-44ef-9b79-28eaa620be69 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:04.171743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 607/1206] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:04.181453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22b85-70c6-4442-96ce-3c09eced510d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:04.182059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22b85-70c6-4442-96ce-3c09eced510d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:04.182239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22b85-70c6-4442-96ce-3c09eced510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:04.205656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-edf22b85-70c6-4442-96ce-3c09eced510d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:04.207852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-edf22b85-70c6-4442-96ce-3c09eced510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:04.345613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 600/1207] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:04.776274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10571e-e4f9-44ef-9b79-28eaa620be69 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:04.961927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10571e-e4f9-44ef-9b79-28eaa620be69 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:05.017702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6d4d-90ab-4187-b5dd-89c485c4eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:05.018397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6d4d-90ab-4187-b5dd-89c485c4eba0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:05.018672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6d4d-90ab-4187-b5dd-89c485c4eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:05.018995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6d4d-90ab-4187-b5dd-89c485c4eba0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:05.040212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc6d4d-90ab-4187-b5dd-89c485c4eba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-acfc6d4d-90ab-4187-b5dd-89c485c4eba0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:21:05.051249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:05.053393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:05.057531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 608/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:21:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:05.065250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22b85-70c6-4442-96ce-3c09eced510d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:05.148544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:05.277824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22b85-70c6-4442-96ce-3c09eced510d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:05.347675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:05.349989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:05.350524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:05.350975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:05.351876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:05.352378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:05.354868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:05.369523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 601/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:21:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:05.379227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6d4d-90ab-4187-b5dd-89c485c4eba0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:05.487331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:05.592171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6d4d-90ab-4187-b5dd-89c485c4eba0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:05.664789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:05.666005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:05.666587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:05.667336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:05.694141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:05.696055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:05.730208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:05.732915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:05.734260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:05.734260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:05.734260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:05.734260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 609/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:05.741478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:05.893534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:05.899410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18b402-9fe7-45a6-907f-388372172942 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:05.961516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:05.962354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:05.962851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:05.963293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:05.964147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:05.964730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:05.966468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:05.995688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 602/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:05.997939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:06.200675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184792bb-311c-4a07-b567-bee273cb030f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:06.202641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:06.265555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:06.266731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:06.267215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:06.267693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:06.281423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:06.283818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:21:06.304057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:06.306281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:06.313479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 610/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:21:06.314218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:06.525157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81ac67-aea0-4467-86f6-14cd13fc0dc8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:06.593357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:06.594435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:06.594857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:06.595293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:06.596646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:06.597105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:06.599488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:06.638516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 603/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Sep 13 12:21:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:06.642801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:06.852585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200020de-592e-42bc-9f57-dcf46a291a03 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:06.924818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a32563-6b05-4ca9-8a9e-42b052b889e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:06.925910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a32563-6b05-4ca9-8a9e-42b052b889e7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:06.926391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a32563-6b05-4ca9-8a9e-42b052b889e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:06.926851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a32563-6b05-4ca9-8a9e-42b052b889e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:07.001254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:07.074186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a32563-6b05-4ca9-8a9e-42b052b889e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:07.076873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a32563-6b05-4ca9-8a9e-42b052b889e7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:07.278767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 611/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:21:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:21:07.285666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:07.323321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:07.456106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725226-4072-4ec9-b2cf-30a7d31cdc4a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:07.518855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:07.519985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:07.520536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:07.521077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:07.543311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:07.545206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:07.570066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:07.572025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:07.573825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:07.573825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:07.573825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:07.573825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 604/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:07.581934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a32563-6b05-4ca9-8a9e-42b052b889e7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:07.678357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:07.735929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a32563-6b05-4ca9-8a9e-42b052b889e7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:07.790132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:07.791179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:07.791644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:07.791961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:07.792825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:07.793959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:07.794758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:07.812767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 612/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:07.819030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:07.960594 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:08.025508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce559-2fcc-4127-8366-17774bcccfb7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:08.083272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:08.084166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:08.084520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:08.084907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:08.099005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:08.101488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:21:08.127368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:08.129751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:08.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 605/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:21:08.135823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:08.302487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd10b90-3411-4958-98f1-520292f30e39 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:08.335238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:08.351458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453011b9-07c2-4654-8db4-828d85c51f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:08.352198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453011b9-07c2-4654-8db4-828d85c51f9d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:08.352498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453011b9-07c2-4654-8db4-828d85c51f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:08.352810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453011b9-07c2-4654-8db4-828d85c51f9d None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:08.353687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453011b9-07c2-4654-8db4-828d85c51f9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:08.354069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453011b9-07c2-4654-8db4-828d85c51f9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:08.356135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453011b9-07c2-4654-8db4-828d85c51f9d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:08.369844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 613/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:08.376684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:08.518040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1af05-80cb-4958-b138-6242c0af111a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:08.564248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:08.574642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed263053-b4f5-4ac2-b063-d7703f77c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:08.576353 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed263053-b4f5-4ac2-b063-d7703f77c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:08.576875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed263053-b4f5-4ac2-b063-d7703f77c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:08.577255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed263053-b4f5-4ac2-b063-d7703f77c5d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:08.578315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed263053-b4f5-4ac2-b063-d7703f77c5d6 None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=3ee6a88b338342c7ab991c5511e7b115) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:08.578986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed263053-b4f5-4ac2-b063-d7703f77c5d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:08.581003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed263053-b4f5-4ac2-b063-d7703f77c5d6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:08.591162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 606/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:21:08 2022] GET /identity/v3/role_assignments?user.id=3ee6a88b338342c7ab991c5511e7b115&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:11.073959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfa2f-8bfb-4122-b951-d8e120ccefbd None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:11.074849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfa2f-8bfb-4122-b951-d8e120ccefbd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:11.075007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfa2f-8bfb-4122-b951-d8e120ccefbd None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:11.076977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 614/1220] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:11.083198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20b6b5-95fd-41bc-b9fd-884fa3af0e0f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:11.084041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20b6b5-95fd-41bc-b9fd-884fa3af0e0f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:11.084041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20b6b5-95fd-41bc-b9fd-884fa3af0e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:11.105923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ed20b6b5-95fd-41bc-b9fd-884fa3af0e0f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:11.108040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ed20b6b5-95fd-41bc-b9fd-884fa3af0e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:11.193095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 607/1221] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:11.535498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbfa2f-8bfb-4122-b951-d8e120ccefbd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:11.678872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbfa2f-8bfb-4122-b951-d8e120ccefbd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:11.741313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fa147-91e3-4a83-b44b-d8b78738b913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:11.742450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fa147-91e3-4a83-b44b-d8b78738b913 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:11.742967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fa147-91e3-4a83-b44b-d8b78738b913 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:11.743503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fa147-91e3-4a83-b44b-d8b78738b913 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:11.758963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fa147-91e3-4a83-b44b-d8b78738b913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-224fa147-91e3-4a83-b44b-d8b78738b913 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:21:11.766905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:11.772887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:11.774668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 615/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:21:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:11.777005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20b6b5-95fd-41bc-b9fd-884fa3af0e0f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:11.984503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20b6b5-95fd-41bc-b9fd-884fa3af0e0f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:12.023493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:12.043770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:12.044870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:12.045362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:12.045952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:12.046925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:12.047479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:12.050009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:12.067943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 608/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:21:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:12.073614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fa147-91e3-4a83-b44b-d8b78738b913 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:12.133724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:12.219760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fa147-91e3-4a83-b44b-d8b78738b913 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:12.288749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:12.289724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:12.290215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:12.290693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:12.312045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:12.314664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:12.346744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:12.348737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:12.351070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:12.351070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:12.351070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:12.351070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 616/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:12.359694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:12.540902 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036eaea-0094-4bdb-93dd-c3d961f33b45 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:12.596819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:12.597863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:12.598344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:12.598809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:12.599945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:12.600480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:12.603064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:12.622373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 609/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:12.628541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:12.776937 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:12.785703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92a83a-e678-44f6-8a95-72dd313a811b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:12.843591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:12.844139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:12.844442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:12.844713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:12.856985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:12.858935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:21:12.874895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:12.876889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:12.879211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 617/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:21:12.886411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:12.999165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:13.080515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dd571-cfca-4aff-b1a0-ba1c12993276 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:13.125194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:13.126019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:13.126332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:13.126561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:13.127455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:13.127886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:13.129702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:13.156027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 610/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Sep 13 12:21:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:13.163533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:13.329461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8243f-b626-4bed-adde-a5973f5d4462 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:13.392132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:13.392961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:13.393338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:13.393725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:13.410577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:13.412098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:13.438708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:13.439974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:13.441128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:13.441128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:13.441128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:13.441128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 618/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:21:13.447178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:13.599342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010fd3f-1e59-4cba-80f0-9df6f70c3023 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:13.605862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:13.670453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:13.671487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:13.671962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:13.672480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:13.673692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:13.674240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:13.676941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:13.704477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 611/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:13.714306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:13.741101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:13.908890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca197e5a-bccd-4068-9010-a07ee2b154c1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:13.960569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:13.961020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:13.961372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:13.961681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:13.970792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:13.972267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:21:13.989148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:13.990247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:13.991300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 619/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:21:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:13.999839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:14.153850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6c0b0-6fd2-4445-9954-3b06cd792e97 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:14.221840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43382e3f-4903-4afe-bdfd-2b48533b8710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:14.224148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43382e3f-4903-4afe-bdfd-2b48533b8710 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:14.224929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43382e3f-4903-4afe-bdfd-2b48533b8710 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:14.225306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43382e3f-4903-4afe-bdfd-2b48533b8710 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:14.226172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43382e3f-4903-4afe-bdfd-2b48533b8710 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:14.226547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43382e3f-4903-4afe-bdfd-2b48533b8710 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:14.228910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43382e3f-4903-4afe-bdfd-2b48533b8710 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:14.247989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 612/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:14.256803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:14.362692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:14.421378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6311c6-33ae-46a6-8d5e-66683ad38a95 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:14.479783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f23006-7d2a-4c58-8789-3608b0e3419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:14.480651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23006-7d2a-4c58-8789-3608b0e3419c None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:14.481156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23006-7d2a-4c58-8789-3608b0e3419c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:14.481382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23006-7d2a-4c58-8789-3608b0e3419c None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/3ee6a88b338342c7ab991c5511e7b115/roles/e45cf88b951c40d793eb810b5b33c8de` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:14.504805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23006-7d2a-4c58-8789-3608b0e3419c None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=3ee6a88b338342c7ab991c5511e7b115, role_id=e45cf88b951c40d793eb810b5b33c8de)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:14.508321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23006-7d2a-4c58-8789-3608b0e3419c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:14.528446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 620/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:21:14 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/3ee6a88b338342c7ab991c5511e7b115/roles/e45cf88b951c40d793eb810b5b33c8de => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:21:17.228103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5a7a8-be0d-45bb-ac53-aca68b856e6c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:17.228780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5a7a8-be0d-45bb-ac53-aca68b856e6c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:17.229054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5a7a8-be0d-45bb-ac53-aca68b856e6c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:17.230923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 613/1233] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:17.239909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a356784-dab0-45ca-8da1-d8f985d3fc03 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:17.240580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a356784-dab0-45ca-8da1-d8f985d3fc03 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:17.241032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a356784-dab0-45ca-8da1-d8f985d3fc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:17.267266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1a356784-dab0-45ca-8da1-d8f985d3fc03 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:17.268722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1a356784-dab0-45ca-8da1-d8f985d3fc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:17.366920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 621/1234] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:17.674283 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5a7a8-be0d-45bb-ac53-aca68b856e6c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:17.720586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:17.865918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5a7a8-be0d-45bb-ac53-aca68b856e6c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:17.917074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28429-5438-44e3-a444-b72b716cd831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:17.918824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28429-5438-44e3-a444-b72b716cd831 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:17.919292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28429-5438-44e3-a444-b72b716cd831 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:17.919726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28429-5438-44e3-a444-b72b716cd831 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:17.932960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d28429-5438-44e3-a444-b72b716cd831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-72d28429-5438-44e3-a444-b72b716cd831 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:21:17.939929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:17.942110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:21:17.944041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:17.952438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 614/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Tue Sep 13 12:21:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:17.956231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a356784-dab0-45ca-8da1-d8f985d3fc03 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:18.017614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:18.102317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a356784-dab0-45ca-8da1-d8f985d3fc03 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:18.152041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:18.153657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:18.154054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:18.154466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:18.155430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:18.155932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:18.158114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:18.173385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 622/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Tue Sep 13 12:21:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:18.174956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28429-5438-44e3-a444-b72b716cd831 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:18.318320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:18.347705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28429-5438-44e3-a444-b72b716cd831 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:18.393740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:18.394487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:18.394804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:18.395078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:18.410503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:18.413334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:18.442656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:18.444778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:18.446610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:18.446610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:18.446610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:18.446610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 615/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:18.453162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:18.611375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ac687-f348-4c21-a0a3-50d769602560 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:18.625459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:18.671909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:18.672938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:18.673412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:18.673873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:18.675019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:18.675560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:18.678281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:18.696655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 623/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:18.706582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:18.852487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b70690-aba4-406f-965e-8624e650f480 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:18.912001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:18.912713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:18.912988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:18.913255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:18.916686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:18.924952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:18.926753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:21:18.943079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:18.944277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:18.945405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:18.952064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 616/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:18.953512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:19.078390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb46e13-28a2-4fa2-877c-5f4bd8c1da7a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:19.119948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:19.120841 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:19.121203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:19.121549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:19.122520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:19.122890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:19.124647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:19.153302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 624/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Sep 13 12:21:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:19.159886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:19.337480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bdd90-aa6d-4e6f-8715-59a889767462 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:19.397120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969bac3-f04e-42f4-a41e-58b9701999cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:19.398669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969bac3-f04e-42f4-a41e-58b9701999cc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:19.399240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969bac3-f04e-42f4-a41e-58b9701999cc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:19.399743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969bac3-f04e-42f4-a41e-58b9701999cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:19.514170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:19.524980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969bac3-f04e-42f4-a41e-58b9701999cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:19.526631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969bac3-f04e-42f4-a41e-58b9701999cc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:19.700211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 617/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:21:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:21:19.709075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:19.770341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:19.892701 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19b7f4-f7b0-4e6c-b8c2-86f7f2a11461 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:19.943025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:19.944138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:19.944641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:19.944993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:19.960027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:19.961947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:19.982780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:19.984675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:19.986259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:19.986259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:19.986259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:19.986259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 625/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:19.990645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969bac3-f04e-42f4-a41e-58b9701999cc None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:20.150675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:20.162940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969bac3-f04e-42f4-a41e-58b9701999cc None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:20.231894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:20.232694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:20.233021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:20.233417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:20.234668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:20.235337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:20.237268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:20.263944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 618/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:20.265750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:20.380149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:20.414082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b23090-664a-45bc-b9ce-85cfd333730b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:20.478344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:20.479368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:20.479870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:20.480965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:20.491878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:20.494450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:21:20.512778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:20.514874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:20.516909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 626/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:20.522506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:20.711320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fc84a-fcc5-48cf-a9e2-4f98fef8c528 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:20.772500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae53dd-e5bf-4d51-b0e4-6a7532143bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:20.773561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae53dd-e5bf-4d51-b0e4-6a7532143bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:20.773919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae53dd-e5bf-4d51-b0e4-6a7532143bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:20.774234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae53dd-e5bf-4d51-b0e4-6a7532143bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:20.775112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae53dd-e5bf-4d51-b0e4-6a7532143bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:20.775475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae53dd-e5bf-4d51-b0e4-6a7532143bc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:20.777302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae53dd-e5bf-4d51-b0e4-6a7532143bc0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:20.802875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 619/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:20.804314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:20.951857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f7ba-fd5b-4892-9023-65f43b45a0bf None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:21.004877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2045ca8-238b-4d98-971b-f4684e0ad57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:21.005877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045ca8-238b-4d98-971b-f4684e0ad57d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:21.006346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045ca8-238b-4d98-971b-f4684e0ad57d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:21.006872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2045ca8-238b-4d98-971b-f4684e0ad57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:21.008105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2045ca8-238b-4d98-971b-f4684e0ad57d None admin] RBAC: Adding query filter params (role.id=e45cf88b951c40d793eb810b5b33c8de, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=3ee6a88b338342c7ab991c5511e7b115) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:21.008628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2045ca8-238b-4d98-971b-f4684e0ad57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:21.010537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2045ca8-238b-4d98-971b-f4684e0ad57d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:21.019428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 627/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:21:20 2022] GET /identity/v3/role_assignments?user.id=3ee6a88b338342c7ab991c5511e7b115&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e45cf88b951c40d793eb810b5b33c8de => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:24.114907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1ea7-5c97-4d9e-a95f-27574f9bf79a None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:24.115505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1ea7-5c97-4d9e-a95f-27574f9bf79a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:24.115505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1ea7-5c97-4d9e-a95f-27574f9bf79a None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:24.116883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 620/1247] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:24.123618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3e240-c71a-455f-a7c6-120fddb45611 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:24.124704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3e240-c71a-455f-a7c6-120fddb45611 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:24.124704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3e240-c71a-455f-a7c6-120fddb45611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:24.132678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:24.150138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-75d3e240-c71a-455f-a7c6-120fddb45611 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:24.152021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-75d3e240-c71a-455f-a7c6-120fddb45611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:24.262355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 628/1248] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:24.611411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf1ea7-5c97-4d9e-a95f-27574f9bf79a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:24.639732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:24.788332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf1ea7-5c97-4d9e-a95f-27574f9bf79a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:24.844657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b46b0-84da-4096-a2a8-c283abd2c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:24.845389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b46b0-84da-4096-a2a8-c283abd2c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:24.845790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b46b0-84da-4096-a2a8-c283abd2c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:24.846183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b46b0-84da-4096-a2a8-c283abd2c4f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:24.867369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b46b0-84da-4096-a2a8-c283abd2c4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4f2b46b0-84da-4096-a2a8-c283abd2c4f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:21:24.874438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:24.876811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:24.878682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 621/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:21:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:24.886655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3e240-c71a-455f-a7c6-120fddb45611 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:25.054690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3e240-c71a-455f-a7c6-120fddb45611 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:25.103705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:25.111480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:25.112291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:25.112709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:25.113144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:25.114080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:25.114452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:25.116194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:25.131965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 629/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:21:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:25.142882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b46b0-84da-4096-a2a8-c283abd2c4f3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:25.267689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:25.303494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b46b0-84da-4096-a2a8-c283abd2c4f3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:25.364985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:25.366079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:25.366595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:25.367072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:25.381674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:25.383390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:25.406629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:25.407798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:25.410475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:25.410475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:25.410475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:25.410475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 622/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:25.416641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:25.597678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42cd24-51f8-4595-a7ce-5e0acd68547b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:25.656653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:25.657621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:25.658022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:25.658329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:25.659249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:25.659581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:25.662142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:25.680723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 630/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:25.688816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:25.874637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdba53-0212-44a7-9d0d-d9ebed6a35c6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:25.922726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:25.937085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:25.937867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:25.938213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:25.938564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:25.948183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:25.950031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:21:25.964744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:25.966857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:25.968903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 623/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:21:25.973883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:26.072828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:26.143446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae6e2-4016-4c53-bcd4-7a3800b94c7a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:26.209607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:26.210270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:26.210676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:26.211046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:26.212211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:26.212722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:26.215222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:26.247433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 631/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Sep 13 12:21:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:26.257870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:26.447473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e87a60-7aca-4fbb-92f4-1ab3b88f75c5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:26.501069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14390e-5739-4268-a6da-d4dca3bc28e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:26.501832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14390e-5739-4268-a6da-d4dca3bc28e3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:26.502220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14390e-5739-4268-a6da-d4dca3bc28e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:26.502608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14390e-5739-4268-a6da-d4dca3bc28e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:26.575495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:26.592248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14390e-5739-4268-a6da-d4dca3bc28e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:26.594031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14390e-5739-4268-a6da-d4dca3bc28e3 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:26.728783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 624/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:21:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 12:21:26.737282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:26.874571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f256e9-0edf-451d-8035-2b90f3fc982e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:26.896323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:26.927495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:26.928273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:26.928609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:26.928919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:26.943044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:26.944555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:26.968136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:26.969364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:26.970444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:26.970444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:26.970444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:26.970444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 632/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:26.976753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14390e-5739-4268-a6da-d4dca3bc28e3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:27.120418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:27.141777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14390e-5739-4268-a6da-d4dca3bc28e3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:27.189890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:27.190749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:27.191107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:27.191480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:27.192573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:27.193016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:27.194830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:27.211486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 625/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:27.218880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:27.356995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c275a-6d04-46d1-a0bf-a66cc11ea702 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:27.398886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:27.399448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:27.399727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:27.399999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:27.408581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:27.410069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:21:27.423021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:27.424726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:27.426302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 633/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:27.431114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:27.569684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdde42f-63a5-47b8-9249-4f4c2fe34473 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:27.624769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e592-bd5e-4c8c-a9f4-39b6a66b306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:27.625414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e592-bd5e-4c8c-a9f4-39b6a66b306b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:27.625698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e592-bd5e-4c8c-a9f4-39b6a66b306b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:27.625988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e592-bd5e-4c8c-a9f4-39b6a66b306b None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:27.626691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e592-bd5e-4c8c-a9f4-39b6a66b306b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:27.627002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e592-bd5e-4c8c-a9f4-39b6a66b306b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:27.628627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e592-bd5e-4c8c-a9f4-39b6a66b306b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:27.648431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 626/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:27.656970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:27.690391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:27.815404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd6420-0158-46bb-8e33-1a66d6637c65 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:27.880009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d76e4-dae4-4e14-8e97-e06a872eaa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:27.880699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d76e4-dae4-4e14-8e97-e06a872eaa6d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:27.880982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d76e4-dae4-4e14-8e97-e06a872eaa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:27.881340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d76e4-dae4-4e14-8e97-e06a872eaa6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:27.882112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d76e4-dae4-4e14-8e97-e06a872eaa6d None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=3ee6a88b338342c7ab991c5511e7b115) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:27.882421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d76e4-dae4-4e14-8e97-e06a872eaa6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:27.884036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d76e4-dae4-4e14-8e97-e06a872eaa6d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:27.890859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 634/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:21:27 2022] GET /identity/v3/role_assignments?user.id=3ee6a88b338342c7ab991c5511e7b115&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:30.360444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c69f84-c152-4495-b257-b3d8aace7e7d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:30.361208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c69f84-c152-4495-b257-b3d8aace7e7d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:30.361208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c69f84-c152-4495-b257-b3d8aace7e7d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:30.362747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 627/1261] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:30.369371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6795-e45e-4a3e-8130-01ad560f58d8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:30.370275 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6795-e45e-4a3e-8130-01ad560f58d8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:30.370275 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6795-e45e-4a3e-8130-01ad560f58d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:30.394292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a4be6795-e45e-4a3e-8130-01ad560f58d8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:30.395551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a4be6795-e45e-4a3e-8130-01ad560f58d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:30.497868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 635/1262] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:30.789717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c69f84-c152-4495-b257-b3d8aace7e7d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:30.804038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:30.926895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c69f84-c152-4495-b257-b3d8aace7e7d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:30.973537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bfc8b-9db3-495b-a4ba-5930378bd1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:30.974204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfc8b-9db3-495b-a4ba-5930378bd1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:30.974487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfc8b-9db3-495b-a4ba-5930378bd1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:30.974764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfc8b-9db3-495b-a4ba-5930378bd1c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:30.988731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bfc8b-9db3-495b-a4ba-5930378bd1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e24bfc8b-9db3-495b-a4ba-5930378bd1c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:21:30.994041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:30.995979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:30.998194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 628/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:21:31.005659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be6795-e45e-4a3e-8130-01ad560f58d8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:31.032891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:31.156340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be6795-e45e-4a3e-8130-01ad560f58d8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:31.211642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:31.212435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:31.212731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:31.212999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:31.213731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:31.214149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:31.216658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:31.227432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 636/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:31.241086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bfc8b-9db3-495b-a4ba-5930378bd1c8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:31.359765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:31.410247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bfc8b-9db3-495b-a4ba-5930378bd1c8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:31.458305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:31.458983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:31.459258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:31.459533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:31.474354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:31.475874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:31.495163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:31.497056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:31.498906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:31.498906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:31.498906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:31.498906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 629/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:31.504672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:31.621561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:31.650098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a546-97ed-4815-9cdb-eda773fefddc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:31.695853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:31.697124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:31.697449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:31.697719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:31.700132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:31.700132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:31.700955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:31.721516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 637/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:31.733613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:31.939857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94a4fe-9d30-4029-a168-474a0423b691 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:31.980793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:32.008205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:32.009327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:32.009806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:32.010283 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:32.025625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:32.027208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:21:32.041193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:32.042361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:32.044264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 630/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:32.050516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:32.176031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2024a-90b6-48df-87c9-20a45cb6ba60 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:32.222831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:32.223797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:32.224174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:32.224652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:32.225690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:32.226251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:32.227907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:32.239454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:32.255894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 638/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Sep 13 12:21:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:32.262536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:32.394259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a658a-0b45-4162-84b4-3d98eab83979 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:32.435786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:32.436576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:32.436759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:32.437030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:32.450583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:32.452087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:32.469400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:32.471535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:32.472560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:32.472560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:32.472560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:32.472560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 631/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:32.478445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:32.595703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9523df-8be2-471a-ac90-f7bd00884e98 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:32.634596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:32.635274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:32.635602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:32.635945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:32.636758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:32.637095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:32.638596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:32.652379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 639/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:32.659163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:32.719855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:32.836958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c17e9-9fd8-4355-9754-8c6c513d1eb8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:32.877933 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:32.878904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:32.879224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:32.879565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:32.888680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:32.890355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:21:32.904450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:32.906152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:32.907143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 632/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:21:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:32.912094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:32.986476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:33.036518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0e38-4591-4fa4-89ca-8b5499ae0a39 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:33.075167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e4b4d-080e-433b-ac72-ac3dc01fad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:33.075869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4b4d-080e-433b-ac72-ac3dc01fad1f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:33.076195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4b4d-080e-433b-ac72-ac3dc01fad1f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:33.076555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4b4d-080e-433b-ac72-ac3dc01fad1f None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:33.077317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e4b4d-080e-433b-ac72-ac3dc01fad1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:33.077662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e4b4d-080e-433b-ac72-ac3dc01fad1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:33.079180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e4b4d-080e-433b-ac72-ac3dc01fad1f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:33.094049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 640/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:21:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:33.101019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:33.230591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:33.243102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97cb1a-55bb-4f40-bf67-0b0b8a26316e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:33.287347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dde9a1-d75b-455a-842b-798ab7d9198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:33.288031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde9a1-d75b-455a-842b-798ab7d9198c None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:33.288305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde9a1-d75b-455a-842b-798ab7d9198c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:33.288609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde9a1-d75b-455a-842b-798ab7d9198c None admin] PATH_INFO: `/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/3ee6a88b338342c7ab991c5511e7b115/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:33.290576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dde9a1-d75b-455a-842b-798ab7d9198c None admin] RBAC: Authorizing `identity:create_grant(project_id=3a57dd3f74a548a9bdee57f1cdacf5be, user_id=3ee6a88b338342c7ab991c5511e7b115, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:33.292039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dde9a1-d75b-455a-842b-798ab7d9198c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:33.308606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 633/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Tue Sep 13 12:21:33 2022] PUT /identity/v3/projects/3a57dd3f74a548a9bdee57f1cdacf5be/users/3ee6a88b338342c7ab991c5511e7b115/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:21:35.620991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb91be3-144a-4acc-8e72-03a5d6870fd2 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:35.621636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb91be3-144a-4acc-8e72-03a5d6870fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:35.621636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb91be3-144a-4acc-8e72-03a5d6870fd2 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:35.623007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 641/1274] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:35.632422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8d46-4cfb-482e-a03d-c4acfcc5c42b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:35.633087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8d46-4cfb-482e-a03d-c4acfcc5c42b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:35.633377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8d46-4cfb-482e-a03d-c4acfcc5c42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:35.666554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-367a8d46-4cfb-482e-a03d-c4acfcc5c42b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:35.668626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-367a8d46-4cfb-482e-a03d-c4acfcc5c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:35.786111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 634/1275] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:36.063680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb91be3-144a-4acc-8e72-03a5d6870fd2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:36.211031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb91be3-144a-4acc-8e72-03a5d6870fd2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:36.236275 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:36.256197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb2df-e0b5-4070-a4df-6b12da20bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:36.257002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb2df-e0b5-4070-a4df-6b12da20bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:36.257280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb2df-e0b5-4070-a4df-6b12da20bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:36.257552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb2df-e0b5-4070-a4df-6b12da20bdb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:36.273800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eb2df-e0b5-4070-a4df-6b12da20bdb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ab3eb2df-e0b5-4070-a4df-6b12da20bdb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:21:36.283924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:36.285184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:36.286120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 642/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Tue Sep 13 12:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:36.296205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a8d46-4cfb-482e-a03d-c4acfcc5c42b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:36.442375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:36.467682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a8d46-4cfb-482e-a03d-c4acfcc5c42b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:36.508646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:36.509276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:36.509549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:36.509816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:36.510498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:36.510799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:36.512662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:36.523381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 635/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Tue Sep 13 12:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:36.533009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb2df-e0b5-4070-a4df-6b12da20bdb9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:36.708769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb2df-e0b5-4070-a4df-6b12da20bdb9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:36.752350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:36.753106 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:36.753431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:36.753749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:36.766332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:36.768050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:36.786585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:36.788513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:36.790245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:36.790245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:36.790245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:36.790245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 643/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:36.794656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:36.916223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961da7-4238-49bc-86a9-5288bef70e28 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:36.956010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:36.956729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:36.957085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:36.957410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:36.958118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:36.958466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:36.959958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:36.974010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 636/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:36.980525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:37.017561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:37.100958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac16b9-d6ef-4530-93a5-84b8d93496a8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:37.143235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:37.143907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:37.144184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:37.144477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:37.155380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:37.156920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:21:37.170294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:37.171430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:37.172503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 644/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:37.178740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:37.183343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:37.361786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490107c-ac1c-4015-b31b-c6fd5f83262f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:37.427966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:37.429074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:37.429553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:37.430018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:37.431418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:37.431955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:37.434974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:37.469136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 637/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Tue Sep 13 12:21:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:37.475533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:37.592469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:37.604794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a4c02-7840-4661-a8b9-4692ef92c8fe None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:37.645626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fb4aa-9eeb-4789-969d-e1be3508671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:37.646241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fb4aa-9eeb-4789-969d-e1be3508671b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:37.646511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fb4aa-9eeb-4789-969d-e1be3508671b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:37.646772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fb4aa-9eeb-4789-969d-e1be3508671b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:37.728276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fb4aa-9eeb-4789-969d-e1be3508671b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:37.729944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fb4aa-9eeb-4789-969d-e1be3508671b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:37.829986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:37.842859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 645/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Tue Sep 13 12:21:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:21:37.849123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:37.940765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:37.993808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53ba49-866e-4e34-b214-f928567b9d75 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:38.034885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:38.035544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:38.035818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:38.036090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:38.048848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:38.050367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:21:38.069772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:38.071541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:21:38.073321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:21:38.073321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:21:38.073321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:38.073321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 638/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:38.078650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fb4aa-9eeb-4789-969d-e1be3508671b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:38.193205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fb4aa-9eeb-4789-969d-e1be3508671b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:38.252010 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:38.253083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:38.253579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:38.254056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:38.255203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:38.255738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:38.258038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:38.279663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 646/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Tue Sep 13 12:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:38.286146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:38.414417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15664ed-b277-4eab-93b7-018f98ca5715 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:38.430103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:38.456945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:38.457693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:38.458069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:38.458437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:38.469427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:38.471068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:21:38.484989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:38.491693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: ERROR keystone.server.flask.application Sep 13 12:21:38.493104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 639/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Tue Sep 13 12:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:38.493815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:38.567639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:38.641176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781109-484d-4668-95b6-33d20b1e7df1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:38.681345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ec5a-ccb0-4b75-9110-5f26ecda2f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:38.682042 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ec5a-ccb0-4b75-9110-5f26ecda2f64 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:38.682363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ec5a-ccb0-4b75-9110-5f26ecda2f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:38.682791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ec5a-ccb0-4b75-9110-5f26ecda2f64 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:38.683942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ec5a-ccb0-4b75-9110-5f26ecda2f64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:38.684285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ec5a-ccb0-4b75-9110-5f26ecda2f64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:38.685863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ec5a-ccb0-4b75-9110-5f26ecda2f64 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:38.701856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 647/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Tue Sep 13 12:21:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:38.709432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:38.827725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e2b79-8bad-4460-b831-50cd14a4471e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:38.866249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb267222-3611-4a72-a47f-59eaab141b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:38.867013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb267222-3611-4a72-a47f-59eaab141b54 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:38.867241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb267222-3611-4a72-a47f-59eaab141b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:38.867567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb267222-3611-4a72-a47f-59eaab141b54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:38.868435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb267222-3611-4a72-a47f-59eaab141b54 None admin] RBAC: Adding query filter params (role.id=e4f990a9ab47493cb9a9e93707363f32, scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be, user.id=3ee6a88b338342c7ab991c5511e7b115) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:38.868836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb267222-3611-4a72-a47f-59eaab141b54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:38.870853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb267222-3611-4a72-a47f-59eaab141b54 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:38.878527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 640/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Tue Sep 13 12:21:38 2022] GET /identity/v3/role_assignments?user.id=3ee6a88b338342c7ab991c5511e7b115&scope.project.id=3a57dd3f74a548a9bdee57f1cdacf5be&role.id=e4f990a9ab47493cb9a9e93707363f32 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:41.168306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4d75-7207-44c2-b2c1-02d1017b34b4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:41.168940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4d75-7207-44c2-b2c1-02d1017b34b4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:41.168940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4d75-7207-44c2-b2c1-02d1017b34b4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:41.170435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 648/1288] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:41.176830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc88e0-266d-4859-8921-d4589b773896 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:41.177386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc88e0-266d-4859-8921-d4589b773896 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:41.177386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc88e0-266d-4859-8921-d4589b773896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:41.198497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-89bc88e0-266d-4859-8921-d4589b773896 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:41.200533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-89bc88e0-266d-4859-8921-d4589b773896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:41.236961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:41.288532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 641/1289] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:41.555816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b4d75-7207-44c2-b2c1-02d1017b34b4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:41.676182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b4d75-7207-44c2-b2c1-02d1017b34b4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:41.689985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:41.734757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:41.735505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:41.735792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:41.736255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:41.737036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:41.738695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:41.752470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:41.754401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:41.755437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 649/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:21:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:41.766424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc88e0-266d-4859-8921-d4589b773896 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:41.907042 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc88e0-266d-4859-8921-d4589b773896 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:41.947718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2c074-41d9-41e6-8da8-0a7ff7c48796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:41.948663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2c074-41d9-41e6-8da8-0a7ff7c48796 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:41.949131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2c074-41d9-41e6-8da8-0a7ff7c48796 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:41.949544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2c074-41d9-41e6-8da8-0a7ff7c48796 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:41.950203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2c074-41d9-41e6-8da8-0a7ff7c48796 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:41.950509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2c074-41d9-41e6-8da8-0a7ff7c48796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:41.951930 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2c074-41d9-41e6-8da8-0a7ff7c48796 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:41.958088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 642/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Tue Sep 13 12:21:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:41.968771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:42.162103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2f0b0-b629-4d61-bc5b-32e4ec3cac13 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:42.219217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909608b-7517-4b6b-87c4-c810cdd08c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:42.219975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909608b-7517-4b6b-87c4-c810cdd08c09 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:42.220218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909608b-7517-4b6b-87c4-c810cdd08c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:42.220509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909608b-7517-4b6b-87c4-c810cdd08c09 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:42.221221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909608b-7517-4b6b-87c4-c810cdd08c09 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:42.221506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909608b-7517-4b6b-87c4-c810cdd08c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:42.222981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909608b-7517-4b6b-87c4-c810cdd08c09 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:42.228374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 650/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Tue Sep 13 12:21:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:44.596559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557086f-b295-4178-94fe-68cd7fcdbbc8 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:44.597184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557086f-b295-4178-94fe-68cd7fcdbbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:44.597184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557086f-b295-4178-94fe-68cd7fcdbbc8 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:44.598519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 643/1293] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:44.604964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194541d8-2620-4ac4-bbf0-e0e9174aa2a7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:44.605541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194541d8-2620-4ac4-bbf0-e0e9174aa2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:44.605807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194541d8-2620-4ac4-bbf0-e0e9174aa2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:44.626997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-194541d8-2620-4ac4-bbf0-e0e9174aa2a7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:44.628236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-194541d8-2620-4ac4-bbf0-e0e9174aa2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:44.663480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:44.740461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 651/1294] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:21:45.010597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557086f-b295-4178-94fe-68cd7fcdbbc8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:45.048932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:45.144590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557086f-b295-4178-94fe-68cd7fcdbbc8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:45.210282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7315e2-1fab-4771-8061-39f233be1238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:45.211341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7315e2-1fab-4771-8061-39f233be1238 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:45.211829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7315e2-1fab-4771-8061-39f233be1238 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:45.212298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7315e2-1fab-4771-8061-39f233be1238 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:45.215779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7315e2-1fab-4771-8061-39f233be1238 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:45.217692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7315e2-1fab-4771-8061-39f233be1238 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:45.239785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 644/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Tue Sep 13 12:21:45 2022] POST /identity/v3/services => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:21:47.625787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4474-a3b0-4a23-a6e5-81cac7f71a15 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:47.626678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4474-a3b0-4a23-a6e5-81cac7f71a15 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:47.626678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4474-a3b0-4a23-a6e5-81cac7f71a15 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:47.627935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 652/1296] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:47.637084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ed0a-078b-48db-a690-f114291e409a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:47.637700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ed0a-078b-48db-a690-f114291e409a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:47.637700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ed0a-078b-48db-a690-f114291e409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:47.668220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1ac1ed0a-078b-48db-a690-f114291e409a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:47.670360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1ac1ed0a-078b-48db-a690-f114291e409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:47.790151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 645/1297] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:21:48.061002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf4474-a3b0-4a23-a6e5-81cac7f71a15 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:48.198744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf4474-a3b0-4a23-a6e5-81cac7f71a15 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:48.261775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:48.262855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:48.263335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:48.263777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:48.264906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:48.267361 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:48.285172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:48.286488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:48.287733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 653/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:21:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:48.296856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ed0a-078b-48db-a690-f114291e409a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:48.319141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:48.418518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ed0a-078b-48db-a690-f114291e409a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:48.467848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:48.468655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:48.469017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:48.469371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:48.470119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:48.470512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:48.472046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:48.478385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 646/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Tue Sep 13 12:21:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:48.485239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:48.523604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:48.610407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d759740-d944-4e7b-9b54-408e62d20272 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:48.652570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a6762-2a67-4ecb-9f30-424225b29f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:48.653334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6762-2a67-4ecb-9f30-424225b29f1f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:48.653581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6762-2a67-4ecb-9f30-424225b29f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:48.653889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6762-2a67-4ecb-9f30-424225b29f1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:48.654682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a6762-2a67-4ecb-9f30-424225b29f1f None admin] RBAC: Adding query filter params (interface=public, service_id=76ff70df95534117a128f47aacab6f56, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:48.655033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a6762-2a67-4ecb-9f30-424225b29f1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:48.656709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a6762-2a67-4ecb-9f30-424225b29f1f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:48.662926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 654/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Tue Sep 13 12:21:48 2022] GET /identity/v3/endpoints?service_id=76ff70df95534117a128f47aacab6f56&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:21:48.670114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:48.767420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:48.790783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611c02-4de0-4f76-a6e9-14c72f66e8cd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:48.831032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526a05d-2d19-4615-97df-85dba747eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:48.831623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a05d-2d19-4615-97df-85dba747eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:48.831957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a05d-2d19-4615-97df-85dba747eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:48.832274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a05d-2d19-4615-97df-85dba747eaa6 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:48.833057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526a05d-2d19-4615-97df-85dba747eaa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:48.834532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526a05d-2d19-4615-97df-85dba747eaa6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:48.842875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 647/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Tue Sep 13 12:21:48 2022] GET /identity/v3/services => generated 2191 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:21:51.121209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97711670-1c3f-49a4-a3d5-8ebd4294e986 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:51.121835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97711670-1c3f-49a4-a3d5-8ebd4294e986 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:51.121835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97711670-1c3f-49a4-a3d5-8ebd4294e986 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:51.123439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 655/1302] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:51.129936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b776-cf3a-405b-99d0-679c53a10623 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:51.130549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b776-cf3a-405b-99d0-679c53a10623 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:51.130549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550b776-cf3a-405b-99d0-679c53a10623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:51.150859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4550b776-cf3a-405b-99d0-679c53a10623 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:51.152422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4550b776-cf3a-405b-99d0-679c53a10623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:51.235103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 648/1303] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:21:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:21:51.524071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97711670-1c3f-49a4-a3d5-8ebd4294e986 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:51.649482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:51.659434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97711670-1c3f-49a4-a3d5-8ebd4294e986 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:51.700602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:51.701254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:51.701526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:51.701792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:51.702383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:51.703807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:21:51.713917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:21:51.716007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: ERROR keystone.server.flask.application Sep 13 12:21:51.717457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 656/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Tue Sep 13 12:21:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:21:51.722687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550b776-cf3a-405b-99d0-679c53a10623 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:51.817066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:51.847280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550b776-cf3a-405b-99d0-679c53a10623 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:51.890257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0d04c-bda4-47d3-b6d2-eedaaa7ecc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:51.890890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0d04c-bda4-47d3-b6d2-eedaaa7ecc76 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:51.891215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0d04c-bda4-47d3-b6d2-eedaaa7ecc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:51.891517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0d04c-bda4-47d3-b6d2-eedaaa7ecc76 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:51.892175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0d04c-bda4-47d3-b6d2-eedaaa7ecc76 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:21:51.892505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0d04c-bda4-47d3-b6d2-eedaaa7ecc76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:51.894075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0d04c-bda4-47d3-b6d2-eedaaa7ecc76 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:51.900891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 649/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Tue Sep 13 12:21:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:21:51.907903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:52.024558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da613f2-1e9d-4f11-a426-fa3f200c3c8e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:52.066155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809c9ad-6ff2-41c7-9224-4e3e3ca37770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:52.066785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c9ad-6ff2-41c7-9224-4e3e3ca37770 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:52.067133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c9ad-6ff2-41c7-9224-4e3e3ca37770 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:52.067289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c9ad-6ff2-41c7-9224-4e3e3ca37770 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:52.068033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809c9ad-6ff2-41c7-9224-4e3e3ca37770 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:52.069540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809c9ad-6ff2-41c7-9224-4e3e3ca37770 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:52.094569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 657/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:21:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:22:01.896846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=30 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:02.089747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:08.584217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528f6d7-e68c-4160-aa89-61e721a80181 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:08.586038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528f6d7-e68c-4160-aa89-61e721a80181 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:08.586847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528f6d7-e68c-4160-aa89-61e721a80181 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:08.590366 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 650/1307] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:08.597078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332396b4-6936-44c8-9ee9-4d1b6bb57e20 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:08.598017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332396b4-6936-44c8-9ee9-4d1b6bb57e20 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:08.598017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332396b4-6936-44c8-9ee9-4d1b6bb57e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:08.711966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-332396b4-6936-44c8-9ee9-4d1b6bb57e20 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:08.717476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-332396b4-6936-44c8-9ee9-4d1b6bb57e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:08.970536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 658/1308] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:09.398485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be558a77-cc1d-4dba-8877-ee163601d962 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:09.399779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be558a77-cc1d-4dba-8877-ee163601d962 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:09.400413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be558a77-cc1d-4dba-8877-ee163601d962 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:09.403084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 651/1309] 10.222.0.55 () {54 vars in 965 bytes} [Tue Sep 13 12:23:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:09.422558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e93a0-c82d-4b99-94ef-7e87b6e81255 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:09.423035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e93a0-c82d-4b99-94ef-7e87b6e81255 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:09.423497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e93a0-c82d-4b99-94ef-7e87b6e81255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:09.629078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f58e93a0-c82d-4b99-94ef-7e87b6e81255 None None] MFA Rules not processed for user `b310f17f81e040ac80dc1b9de52026f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:09.636702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f58e93a0-c82d-4b99-94ef-7e87b6e81255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:09.687155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:09.837466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 659/1310] 10.222.0.55 () {58 vars in 1062 bytes} [Tue Sep 13 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:23:09.853289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be558a77-cc1d-4dba-8877-ee163601d962 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:09.856548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-be558a77-cc1d-4dba-8877-ee163601d962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:10.129269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be558a77-cc1d-4dba-8877-ee163601d962 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:10.311477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4d7a5-e38e-48ba-9ab5-8de64c675d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:10.313227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d7a5-e38e-48ba-9ab5-8de64c675d0b service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:10.313934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d7a5-e38e-48ba-9ab5-8de64c675d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:10.314609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d7a5-e38e-48ba-9ab5-8de64c675d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:10.318225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bdc4d7a5-e38e-48ba-9ab5-8de64c675d0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:10.437752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:10.552161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d7a5-e38e-48ba-9ab5-8de64c675d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:10.554811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d7a5-e38e-48ba-9ab5-8de64c675d0b service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:10.592194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 652/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:14.372571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fab8-2d46-4e5b-a3e1-fc548ba5277f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:14.373397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fab8-2d46-4e5b-a3e1-fc548ba5277f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:14.373397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fab8-2d46-4e5b-a3e1-fc548ba5277f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:14.374684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 660/1312] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:14.381395 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e3d75-979b-4d29-b485-b36790eb8d3f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:14.382013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e3d75-979b-4d29-b485-b36790eb8d3f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:14.382013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e3d75-979b-4d29-b485-b36790eb8d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:14.480824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ec3e3d75-979b-4d29-b485-b36790eb8d3f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:14.482004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ec3e3d75-979b-4d29-b485-b36790eb8d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:14.604699 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 653/1313] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:23:14.890754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7fab8-2d46-4e5b-a3e1-fc548ba5277f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:14.892524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-93f7fab8-2d46-4e5b-a3e1-fc548ba5277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:15.079571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7fab8-2d46-4e5b-a3e1-fc548ba5277f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:15.190427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:15.193706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c168-67ce-418e-b1cd-6ba31acd5dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:15.194870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c168-67ce-418e-b1cd-6ba31acd5dcc service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:15.196062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c168-67ce-418e-b1cd-6ba31acd5dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:15.196062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c168-67ce-418e-b1cd-6ba31acd5dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:15.199439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1f34c168-67ce-418e-b1cd-6ba31acd5dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:15.373273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c168-67ce-418e-b1cd-6ba31acd5dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:15.375907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c168-67ce-418e-b1cd-6ba31acd5dcc service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:15.402043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 661/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:18.039177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582a87-b3e1-4c75-87e8-34dae4ede73f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:18.039861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582a87-b3e1-4c75-87e8-34dae4ede73f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:18.039861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582a87-b3e1-4c75-87e8-34dae4ede73f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:18.041191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 654/1315] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:18.048307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0bfe-a27d-4be3-9e0a-9e30ce65407e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:18.048935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0bfe-a27d-4be3-9e0a-9e30ce65407e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:18.049288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0bfe-a27d-4be3-9e0a-9e30ce65407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:18.142009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-397e0bfe-a27d-4be3-9e0a-9e30ce65407e None None] MFA Rules not processed for user `ea3ca793c4d044f6aa170e6369215a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:18.143283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-397e0bfe-a27d-4be3-9e0a-9e30ce65407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:18.209271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:18.268452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 662/1316] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:18.583375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627e530-4f8d-476c-9a1e-1c76e927f561 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:18.583720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627e530-4f8d-476c-9a1e-1c76e927f561 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:18.584091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627e530-4f8d-476c-9a1e-1c76e927f561 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:18.586682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 655/1317] 10.222.0.55 () {54 vars in 965 bytes} [Tue Sep 13 12:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:18.595742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03327-5f0c-4347-be89-2c825681138f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:18.596105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03327-5f0c-4347-be89-2c825681138f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:18.596515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b03327-5f0c-4347-be89-2c825681138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:18.692319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-91b03327-5f0c-4347-be89-2c825681138f None None] MFA Rules not processed for user `b310f17f81e040ac80dc1b9de52026f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:18.693742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-91b03327-5f0c-4347-be89-2c825681138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:18.811627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 663/1318] 10.222.0.55 () {58 vars in 1062 bytes} [Tue Sep 13 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:18.821637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627e530-4f8d-476c-9a1e-1c76e927f561 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:18.823216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0627e530-4f8d-476c-9a1e-1c76e927f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:18.834457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:18.964018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627e530-4f8d-476c-9a1e-1c76e927f561 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:19.059189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae00b4e-8085-40da-91f9-e59ad22c87be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:19.059918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00b4e-8085-40da-91f9-e59ad22c87be service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:19.060179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00b4e-8085-40da-91f9-e59ad22c87be service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:19.060542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00b4e-8085-40da-91f9-e59ad22c87be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:19.062516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9ae00b4e-8085-40da-91f9-e59ad22c87be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:19.136666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:19.193081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae00b4e-8085-40da-91f9-e59ad22c87be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:19.194832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae00b4e-8085-40da-91f9-e59ad22c87be service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:19.223425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 656/1319] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:23:22.568751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a35626-e157-4586-9b51-36e441d69f98 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:22.569430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a35626-e157-4586-9b51-36e441d69f98 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:22.569727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a35626-e157-4586-9b51-36e441d69f98 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:22.572739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 664/1320] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:22.578829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f7c0-a8c0-4754-899d-7d4d55980026 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:22.579417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f7c0-a8c0-4754-899d-7d4d55980026 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:22.579417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f7c0-a8c0-4754-899d-7d4d55980026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:22.665628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f1e7f7c0-a8c0-4754-899d-7d4d55980026 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:22.666970 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f1e7f7c0-a8c0-4754-899d-7d4d55980026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:22.787080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 657/1321] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:23.071825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a35626-e157-4586-9b51-36e441d69f98 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:23.073568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b2a35626-e157-4586-9b51-36e441d69f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:23.141160 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:23.209470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a35626-e157-4586-9b51-36e441d69f98 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:23.307122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27247525-0446-45f7-a64c-f927f00a66e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:23.307718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27247525-0446-45f7-a64c-f927f00a66e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:23.308016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27247525-0446-45f7-a64c-f927f00a66e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:23.308290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27247525-0446-45f7-a64c-f927f00a66e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:23.310084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-27247525-0446-45f7-a64c-f927f00a66e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:23.446295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:23.463622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27247525-0446-45f7-a64c-f927f00a66e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:23.465858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27247525-0446-45f7-a64c-f927f00a66e2 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:23.488553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 665/1322] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:27.743373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50dd2-808b-4b08-864d-218dae01875e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:27.744219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50dd2-808b-4b08-864d-218dae01875e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:27.744219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50dd2-808b-4b08-864d-218dae01875e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:27.745357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 658/1323] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:23:27.752490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf4ca7-0c34-4827-8820-2301edb5d3c6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:27.753375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf4ca7-0c34-4827-8820-2301edb5d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:27.753539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf4ca7-0c34-4827-8820-2301edb5d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:27.872577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8dcf4ca7-0c34-4827-8820-2301edb5d3c6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:27.873870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8dcf4ca7-0c34-4827-8820-2301edb5d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:28.019166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 666/1324] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:28.469150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50dd2-808b-4b08-864d-218dae01875e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:28.471178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9ae50dd2-808b-4b08-864d-218dae01875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:28.500105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:28.661377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50dd2-808b-4b08-864d-218dae01875e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:28.809945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2e973-e47d-4875-b50f-5118400fa71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:28.811002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2e973-e47d-4875-b50f-5118400fa71f service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:28.811238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2e973-e47d-4875-b50f-5118400fa71f service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:28.811599 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2e973-e47d-4875-b50f-5118400fa71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:28.813563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e7a2e973-e47d-4875-b50f-5118400fa71f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:28.950390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:29.014903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2e973-e47d-4875-b50f-5118400fa71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:29.017592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2e973-e47d-4875-b50f-5118400fa71f service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:29.054440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 659/1325] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:32.220761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b4c7-f3b8-4a32-a183-49c7c0ff8a8a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:32.221662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b4c7-f3b8-4a32-a183-49c7c0ff8a8a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:32.221662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b4c7-f3b8-4a32-a183-49c7c0ff8a8a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:32.223454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 667/1326] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:32.233546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ff862-30b9-41fd-83bb-0d21ac92f922 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:32.234190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ff862-30b9-41fd-83bb-0d21ac92f922 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:32.234522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ff862-30b9-41fd-83bb-0d21ac92f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:32.374510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cb8ff862-30b9-41fd-83bb-0d21ac92f922 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:32.376715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cb8ff862-30b9-41fd-83bb-0d21ac92f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:32.595785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 660/1327] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:32.926696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871b4c7-f3b8-4a32-a183-49c7c0ff8a8a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:32.930060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d871b4c7-f3b8-4a32-a183-49c7c0ff8a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:33.058859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:33.125919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871b4c7-f3b8-4a32-a183-49c7c0ff8a8a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:33.246352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430ca6b-249c-434b-b435-d509e36abb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:33.247415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430ca6b-249c-434b-b435-d509e36abb45 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:33.247691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430ca6b-249c-434b-b435-d509e36abb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:33.248200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430ca6b-249c-434b-b435-d509e36abb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:33.250308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b430ca6b-249c-434b-b435-d509e36abb45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:33.454458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:33.458988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430ca6b-249c-434b-b435-d509e36abb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:33.461953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430ca6b-249c-434b-b435-d509e36abb45 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:33.494247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 668/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:36.653155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474393c-871b-474a-b07e-e0c5a515cba1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:36.653753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474393c-871b-474a-b07e-e0c5a515cba1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:36.653753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474393c-871b-474a-b07e-e0c5a515cba1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:36.655135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 661/1329] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:36.661369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ea29-a43b-4215-a0ab-6e8fd720913b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:36.661986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ea29-a43b-4215-a0ab-6e8fd720913b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:36.661986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ea29-a43b-4215-a0ab-6e8fd720913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:36.745508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dd21ea29-a43b-4215-a0ab-6e8fd720913b None None] MFA Rules not processed for user `ea3ca793c4d044f6aa170e6369215a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:36.747020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dd21ea29-a43b-4215-a0ab-6e8fd720913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:36.864663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 669/1330] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:37.167180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474393c-871b-474a-b07e-e0c5a515cba1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:37.168869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b474393c-871b-474a-b07e-e0c5a515cba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:37.206378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:37.308373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474393c-871b-474a-b07e-e0c5a515cba1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:37.449848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e4d7f-c4f9-480e-b6cc-37e5e75f7070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:37.450586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4d7f-c4f9-480e-b6cc-37e5e75f7070 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:37.450965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4d7f-c4f9-480e-b6cc-37e5e75f7070 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:37.451335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4d7f-c4f9-480e-b6cc-37e5e75f7070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:37.454393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-031e4d7f-c4f9-480e-b6cc-37e5e75f7070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:37.595159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:37.639173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e4d7f-c4f9-480e-b6cc-37e5e75f7070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:37.641167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e4d7f-c4f9-480e-b6cc-37e5e75f7070 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:37.668544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 662/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:40.404555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc91c-d802-4d2a-8c36-b7b5340f97fa None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:40.405134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc91c-d802-4d2a-8c36-b7b5340f97fa None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:40.405358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc91c-d802-4d2a-8c36-b7b5340f97fa None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:40.406864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 670/1332] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:40.413628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4baa8e-4766-4326-8ca0-9be42f139170 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:40.414212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4baa8e-4766-4326-8ca0-9be42f139170 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:40.414212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4baa8e-4766-4326-8ca0-9be42f139170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:40.514850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ec4baa8e-4766-4326-8ca0-9be42f139170 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:40.516274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ec4baa8e-4766-4326-8ca0-9be42f139170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:40.634204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 663/1333] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:40.925373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc91c-d802-4d2a-8c36-b7b5340f97fa None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:40.927353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4e8cc91c-d802-4d2a-8c36-b7b5340f97fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:41.017516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:41.062285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc91c-d802-4d2a-8c36-b7b5340f97fa None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:41.148864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500aa6c-d406-427e-ae79-00d96cd5e50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:41.149635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500aa6c-d406-427e-ae79-00d96cd5e50f service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:41.149958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500aa6c-d406-427e-ae79-00d96cd5e50f service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:41.150352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500aa6c-d406-427e-ae79-00d96cd5e50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:41.152358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0500aa6c-d406-427e-ae79-00d96cd5e50f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:41.344457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500aa6c-d406-427e-ae79-00d96cd5e50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:41.346909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500aa6c-d406-427e-ae79-00d96cd5e50f service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:41.366836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:41.385566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 671/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:23:43.903544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59f7a-37ca-418d-8af3-1a434b528ed4 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:43.904459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59f7a-37ca-418d-8af3-1a434b528ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:43.904459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59f7a-37ca-418d-8af3-1a434b528ed4 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:43.905516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 664/1335] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:43.912360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f7a0-38d1-4c41-b7ae-e02524063d7e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:43.913248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f7a0-38d1-4c41-b7ae-e02524063d7e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:43.913443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f7a0-38d1-4c41-b7ae-e02524063d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:44.011808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-61b5f7a0-38d1-4c41-b7ae-e02524063d7e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:44.013223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-61b5f7a0-38d1-4c41-b7ae-e02524063d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:44.143261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 672/1336] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:44.459232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c59f7a-37ca-418d-8af3-1a434b528ed4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:44.460000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-05c59f7a-37ca-418d-8af3-1a434b528ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:44.526346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:44.618130 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c59f7a-37ca-418d-8af3-1a434b528ed4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:44.740103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a265e4-0242-43fd-a9b6-eb92149c71cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:44.740767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a265e4-0242-43fd-a9b6-eb92149c71cd service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:44.741055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a265e4-0242-43fd-a9b6-eb92149c71cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:44.741337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a265e4-0242-43fd-a9b6-eb92149c71cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:44.743124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-76a265e4-0242-43fd-a9b6-eb92149c71cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:44.887914 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:44.922906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a265e4-0242-43fd-a9b6-eb92149c71cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:44.927206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a265e4-0242-43fd-a9b6-eb92149c71cd service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:44.953003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 665/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:47.875645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd128-49c8-4945-b152-85279701c288 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:47.876262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd128-49c8-4945-b152-85279701c288 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:47.876801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd128-49c8-4945-b152-85279701c288 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:47.879520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 673/1338] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:47.888097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974dbd-cb55-4ed0-b32a-182b1be3810c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:47.888853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974dbd-cb55-4ed0-b32a-182b1be3810c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:47.888853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62974dbd-cb55-4ed0-b32a-182b1be3810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:47.969101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-62974dbd-cb55-4ed0-b32a-182b1be3810c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:47.970689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-62974dbd-cb55-4ed0-b32a-182b1be3810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:48.091855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 666/1339] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:23:48.391496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd128-49c8-4945-b152-85279701c288 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:48.393237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9d3cd128-49c8-4945-b152-85279701c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:48.495836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:48.531241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd128-49c8-4945-b152-85279701c288 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:48.618810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231119d-3b01-4ad2-bc03-f8add1ea62b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:48.619433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231119d-3b01-4ad2-bc03-f8add1ea62b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:48.619704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231119d-3b01-4ad2-bc03-f8add1ea62b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:48.619974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231119d-3b01-4ad2-bc03-f8add1ea62b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:48.621699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5231119d-3b01-4ad2-bc03-f8add1ea62b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:48.761159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231119d-3b01-4ad2-bc03-f8add1ea62b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:48.762582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231119d-3b01-4ad2-bc03-f8add1ea62b8 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:48.784045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 674/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:23:53.427089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d0e6d-053a-4d3e-8e73-3c6e72f164d0 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:53.427982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d0e6d-053a-4d3e-8e73-3c6e72f164d0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:53.428141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d0e6d-053a-4d3e-8e73-3c6e72f164d0 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:53.430138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 667/1341] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:53.437738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965ec31-1b15-4553-89b2-66be07fac379 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:53.438300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965ec31-1b15-4553-89b2-66be07fac379 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:53.439938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965ec31-1b15-4553-89b2-66be07fac379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:53.451416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:53.557542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7965ec31-1b15-4553-89b2-66be07fac379 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:53.559140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7965ec31-1b15-4553-89b2-66be07fac379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:53.733591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 675/1342] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:54.024675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d0e6d-053a-4d3e-8e73-3c6e72f164d0 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:54.027561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-244d0e6d-053a-4d3e-8e73-3c6e72f164d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:54.112461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:54.216333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d0e6d-053a-4d3e-8e73-3c6e72f164d0 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:54.339246 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480996b-387b-4f01-9490-77b3992d3c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:54.339973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480996b-387b-4f01-9490-77b3992d3c97 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:54.340408 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480996b-387b-4f01-9490-77b3992d3c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:54.340874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480996b-387b-4f01-9490-77b3992d3c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:54.342887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1480996b-387b-4f01-9490-77b3992d3c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:54.459987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:54.483417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480996b-387b-4f01-9490-77b3992d3c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:54.484868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480996b-387b-4f01-9490-77b3992d3c97 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:54.506260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 668/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:58.332351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf93d1-27b1-49ad-93d3-53174d447617 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:58.332994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf93d1-27b1-49ad-93d3-53174d447617 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:58.333298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf93d1-27b1-49ad-93d3-53174d447617 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:58.335559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 676/1344] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:23:58.342359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df2f3-d8ff-4f1a-be48-95119dd32c1c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:58.343061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df2f3-d8ff-4f1a-be48-95119dd32c1c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:58.343061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df2f3-d8ff-4f1a-be48-95119dd32c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:58.453267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d42df2f3-d8ff-4f1a-be48-95119dd32c1c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:58.455275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d42df2f3-d8ff-4f1a-be48-95119dd32c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:58.650564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 669/1345] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:58.945477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf93d1-27b1-49ad-93d3-53174d447617 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:58.948284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5abf93d1-27b1-49ad-93d3-53174d447617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:59.113130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:59.145052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf93d1-27b1-49ad-93d3-53174d447617 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:59.295788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed30a80-a0f6-47c0-9ccf-5462130465d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:59.296857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30a80-a0f6-47c0-9ccf-5462130465d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:59.297306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30a80-a0f6-47c0-9ccf-5462130465d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:59.297727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed30a80-a0f6-47c0-9ccf-5462130465d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:59.300978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-aed30a80-a0f6-47c0-9ccf-5462130465d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:59.515250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed30a80-a0f6-47c0-9ccf-5462130465d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:59.517346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed30a80-a0f6-47c0-9ccf-5462130465d6 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:59.541151 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 677/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:24:04.980505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a1850-b69b-4140-be16-cf3cce69ca50 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:04.981423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a1850-b69b-4140-be16-cf3cce69ca50 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:04.981423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a1850-b69b-4140-be16-cf3cce69ca50 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:04.982545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 670/1347] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:04.988778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994764d-4271-4408-9bbf-35b5ccd14603 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:04.989435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994764d-4271-4408-9bbf-35b5ccd14603 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:04.989435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994764d-4271-4408-9bbf-35b5ccd14603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:05.009155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:05.092004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3994764d-4271-4408-9bbf-35b5ccd14603 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:05.093583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3994764d-4271-4408-9bbf-35b5ccd14603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:05.269776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 678/1348] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:05.601830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a1850-b69b-4140-be16-cf3cce69ca50 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:05.603434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b34a1850-b69b-4140-be16-cf3cce69ca50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:05.707580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:05.790145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a1850-b69b-4140-be16-cf3cce69ca50 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:05.931852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebecf5-7ab9-4c7a-bed5-456bf5af5770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:05.933414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebecf5-7ab9-4c7a-bed5-456bf5af5770 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:05.933414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebecf5-7ab9-4c7a-bed5-456bf5af5770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:05.933813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebecf5-7ab9-4c7a-bed5-456bf5af5770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:05.936673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a3ebecf5-7ab9-4c7a-bed5-456bf5af5770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:06.077761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:06.082012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebecf5-7ab9-4c7a-bed5-456bf5af5770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:06.084462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebecf5-7ab9-4c7a-bed5-456bf5af5770 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:06.109817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 671/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:24:11.784125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6516a-4c29-4978-b8eb-3ae98c602bf8 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:11.785377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6516a-4c29-4978-b8eb-3ae98c602bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:11.785857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6516a-4c29-4978-b8eb-3ae98c602bf8 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:11.788195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 679/1350] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:24:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:11.795752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487a42-8358-4626-ba62-13c26846c850 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:11.797161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487a42-8358-4626-ba62-13c26846c850 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:11.797662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487a42-8358-4626-ba62-13c26846c850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:11.919202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-54487a42-8358-4626-ba62-13c26846c850 None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:11.920809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-54487a42-8358-4626-ba62-13c26846c850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:12.103680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 672/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:15.267782 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=59 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:18.484980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac18f-944f-4ed5-8523-19507a7fac04 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:18.485881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac18f-944f-4ed5-8523-19507a7fac04 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:18.486025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac18f-944f-4ed5-8523-19507a7fac04 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:18.488937 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 680/1352] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:24:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:18.497443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613932a-0596-4e4f-bd74-f63852caeb99 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:18.498265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613932a-0596-4e4f-bd74-f63852caeb99 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:18.498424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613932a-0596-4e4f-bd74-f63852caeb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:18.609744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:18.647194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6613932a-0596-4e4f-bd74-f63852caeb99 None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:18.649070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6613932a-0596-4e4f-bd74-f63852caeb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:18.800035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 673/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:20.509791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e0f93-4deb-4ee7-98fc-ef8d4d2ddbe3 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:20.510376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e0f93-4deb-4ee7-98fc-ef8d4d2ddbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:20.511064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e0f93-4deb-4ee7-98fc-ef8d4d2ddbe3 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:20.513960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 681/1354] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:24:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:20.523789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c842-313e-44da-966a-ed601ff0cede None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:20.524410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c842-313e-44da-966a-ed601ff0cede None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:20.525135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c842-313e-44da-966a-ed601ff0cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:20.635669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3ae5c842-313e-44da-966a-ed601ff0cede None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:20.637335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3ae5c842-313e-44da-966a-ed601ff0cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:20.693849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:20.807990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 674/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:24.536593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737fbb-e6b2-4c2b-95cc-86bbd62ad0db None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:24.536593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737fbb-e6b2-4c2b-95cc-86bbd62ad0db None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:24.537558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737fbb-e6b2-4c2b-95cc-86bbd62ad0db None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:24.540730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 682/1356] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:24.549706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e377d-8604-4f68-ab24-ee7d985d0dd8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:24.550642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e377d-8604-4f68-ab24-ee7d985d0dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:24.551090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e377d-8604-4f68-ab24-ee7d985d0dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:24.718293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-000e377d-8604-4f68-ab24-ee7d985d0dd8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:24.720331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-000e377d-8604-4f68-ab24-ee7d985d0dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:24.939756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 675/1357] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:25.487303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0864d29-3eb6-4e54-9253-a8fa368cb774 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:25.487869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0864d29-3eb6-4e54-9253-a8fa368cb774 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:25.488325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0864d29-3eb6-4e54-9253-a8fa368cb774 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:25.490610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 683/1358] 10.222.0.55 () {54 vars in 962 bytes} [Tue Sep 13 12:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:25.508970 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59270d0-4dbe-4d04-b305-be1367990ae3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:25.509583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59270d0-4dbe-4d04-b305-be1367990ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:25.510004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59270d0-4dbe-4d04-b305-be1367990ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:25.534850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:25.623165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f59270d0-4dbe-4d04-b305-be1367990ae3 None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:25.624169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f59270d0-4dbe-4d04-b305-be1367990ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:25.779219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 676/1359] 10.222.0.55 () {58 vars in 1059 bytes} [Tue Sep 13 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:25.787729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0864d29-3eb6-4e54-9253-a8fa368cb774 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:25.789397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a0864d29-3eb6-4e54-9253-a8fa368cb774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:25.983011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0864d29-3eb6-4e54-9253-a8fa368cb774 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:26.106742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:26.195426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae9970-9f06-4d31-8077-9486959de5b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:26.196052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae9970-9f06-4d31-8077-9486959de5b9 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:26.196317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae9970-9f06-4d31-8077-9486959de5b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:26.196675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae9970-9f06-4d31-8077-9486959de5b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:26.198629 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-aaae9970-9f06-4d31-8077-9486959de5b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:26.384518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae9970-9f06-4d31-8077-9486959de5b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:26.387961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae9970-9f06-4d31-8077-9486959de5b9 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:26.437932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 684/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:24:29.593755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bd0a-4043-4dab-868b-d71996b418df None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:29.594531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bd0a-4043-4dab-868b-d71996b418df None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:29.594531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bd0a-4043-4dab-868b-d71996b418df None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:29.601066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 677/1361] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:29.602870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f524-3d2b-41b1-880d-8cd848eaa591 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:29.603653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f524-3d2b-41b1-880d-8cd848eaa591 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:29.603653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f524-3d2b-41b1-880d-8cd848eaa591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:29.695977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-79c5f524-3d2b-41b1-880d-8cd848eaa591 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:29.698185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-79c5f524-3d2b-41b1-880d-8cd848eaa591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:29.765150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:29.868715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 685/1362] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:30.402205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2bd0a-4043-4dab-868b-d71996b418df None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:30.405387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-34f2bd0a-4043-4dab-868b-d71996b418df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:30.529147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:30.687385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2bd0a-4043-4dab-868b-d71996b418df None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:30.892144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eec953-9ff5-485e-a501-f39c13f04776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:30.892809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec953-9ff5-485e-a501-f39c13f04776 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:30.893087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec953-9ff5-485e-a501-f39c13f04776 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:30.893361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec953-9ff5-485e-a501-f39c13f04776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:30.895678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f4eec953-9ff5-485e-a501-f39c13f04776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:30.931550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:31.074298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eec953-9ff5-485e-a501-f39c13f04776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:31.075867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eec953-9ff5-485e-a501-f39c13f04776 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:31.102291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 678/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:24:34.514215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240990-4c3f-494c-b97b-f0a8e00ab3cb None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:34.515121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240990-4c3f-494c-b97b-f0a8e00ab3cb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:34.515121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240990-4c3f-494c-b97b-f0a8e00ab3cb None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:34.523073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 686/1364] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:34.526292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ed54-e214-4e2d-af89-6649dd9ab94d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:34.527228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ed54-e214-4e2d-af89-6649dd9ab94d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:34.527228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ed54-e214-4e2d-af89-6649dd9ab94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:34.685687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2b40ed54-e214-4e2d-af89-6649dd9ab94d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:34.688033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2b40ed54-e214-4e2d-af89-6649dd9ab94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:34.893742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:34.897673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 679/1365] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:35.251848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948645-2d97-47cc-b32e-568920393bac None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:35.252192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948645-2d97-47cc-b32e-568920393bac None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:35.252373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948645-2d97-47cc-b32e-568920393bac None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:35.254694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 687/1366] 10.222.0.55 () {54 vars in 962 bytes} [Tue Sep 13 12:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:24:35.264169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b4a1-de38-4a21-9406-f48a9bd7874a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:35.264685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b4a1-de38-4a21-9406-f48a9bd7874a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:35.265172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805b4a1-de38-4a21-9406-f48a9bd7874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:35.435751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442355c-3a34-4053-8bec-51c84e368d39 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:35.436491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442355c-3a34-4053-8bec-51c84e368d39 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:35.437043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442355c-3a34-4053-8bec-51c84e368d39 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:35.439775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 688/1367] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:35.444748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4805b4a1-de38-4a21-9406-f48a9bd7874a None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:35.447920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4805b4a1-de38-4a21-9406-f48a9bd7874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:35.448562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd9599-dd46-4588-9d6e-1f08dcaad0c2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:35.449003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd9599-dd46-4588-9d6e-1f08dcaad0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:35.449509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd9599-dd46-4588-9d6e-1f08dcaad0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:35.599030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3afd9599-dd46-4588-9d6e-1f08dcaad0c2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:35.600899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3afd9599-dd46-4588-9d6e-1f08dcaad0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:35.642939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 680/1368] 10.222.0.55 () {58 vars in 1059 bytes} [Tue Sep 13 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:35.656361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805b4a1-de38-4a21-9406-f48a9bd7874a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:35.669233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805b4a1-de38-4a21-9406-f48a9bd7874a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:35.731079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:35.813532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 689/1369] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:35.838208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a63def-d50a-4e15-8a49-7b87fe0e389d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:35.838840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63def-d50a-4e15-8a49-7b87fe0e389d service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:35.839185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63def-d50a-4e15-8a49-7b87fe0e389d service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:35.839515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63def-d50a-4e15-8a49-7b87fe0e389d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:35.841380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b0a63def-d50a-4e15-8a49-7b87fe0e389d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:35.967028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a63def-d50a-4e15-8a49-7b87fe0e389d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:35.968861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a63def-d50a-4e15-8a49-7b87fe0e389d service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:35.992287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 681/1370] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:24:36.362473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b9c3-0048-448f-b3bf-a5898fe1e43b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:36.362953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b9c3-0048-448f-b3bf-a5898fe1e43b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:36.363648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b9c3-0048-448f-b3bf-a5898fe1e43b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:36.366634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 690/1371] 10.222.0.55 () {54 vars in 964 bytes} [Tue Sep 13 12:24:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:36.375312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db728f1-c596-4bce-a4e8-93537656aa1c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:36.376134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db728f1-c596-4bce-a4e8-93537656aa1c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:36.376564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db728f1-c596-4bce-a4e8-93537656aa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:36.474785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:36.519224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0db728f1-c596-4bce-a4e8-93537656aa1c None None] MFA Rules not processed for user `b7b8243a35594402943d956a93cda7b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:36.522220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0db728f1-c596-4bce-a4e8-93537656aa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:36.699673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 682/1372] 10.222.0.55 () {58 vars in 1061 bytes} [Tue Sep 13 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:36.710226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b9c3-0048-448f-b3bf-a5898fe1e43b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:36.711865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6441b9c3-0048-448f-b3bf-a5898fe1e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:36.745453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:36.967643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b9c3-0048-448f-b3bf-a5898fe1e43b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:37.141549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a59b0-dde3-4a16-abb0-f202478b3a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:37.142395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a59b0-dde3-4a16-abb0-f202478b3a33 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:37.142992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a59b0-dde3-4a16-abb0-f202478b3a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:37.143198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a59b0-dde3-4a16-abb0-f202478b3a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:37.146474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1e3a59b0-dde3-4a16-abb0-f202478b3a33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:37.263072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:37.332579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a59b0-dde3-4a16-abb0-f202478b3a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:37.335863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a59b0-dde3-4a16-abb0-f202478b3a33 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:37.366661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 691/1373] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:24:39.649573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6f26-d123-4ff6-8c43-887410050eea None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:39.650232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6f26-d123-4ff6-8c43-887410050eea None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:39.650232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6f26-d123-4ff6-8c43-887410050eea None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:39.651548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 683/1374] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:39.658029 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2f47-c817-4586-8d67-8ab13db4b966 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:39.658895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2f47-c817-4586-8d67-8ab13db4b966 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:39.659054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2f47-c817-4586-8d67-8ab13db4b966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:39.745184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-699f2f47-c817-4586-8d67-8ab13db4b966 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:39.746436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-699f2f47-c817-4586-8d67-8ab13db4b966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:39.909189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 692/1375] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:40.226378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6f26-d123-4ff6-8c43-887410050eea None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:40.228735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fb9e6f26-d123-4ff6-8c43-887410050eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:40.466572 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:40.475089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6f26-d123-4ff6-8c43-887410050eea None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:40.685692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a3796-9642-44f8-9798-88f1078f81d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:40.686687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3796-9642-44f8-9798-88f1078f81d2 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:40.686687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3796-9642-44f8-9798-88f1078f81d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:40.686998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3796-9642-44f8-9798-88f1078f81d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:40.688612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-309a3796-9642-44f8-9798-88f1078f81d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:40.835906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a3796-9642-44f8-9798-88f1078f81d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:40.838129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a3796-9642-44f8-9798-88f1078f81d2 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:40.858305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:40.861804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 684/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:24:43.374865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3ee5-f138-4b00-a47a-5843b9001f93 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:43.375454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3ee5-f138-4b00-a47a-5843b9001f93 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:43.375454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3ee5-f138-4b00-a47a-5843b9001f93 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:43.377422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 693/1377] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:43.383396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c979-4c30-4fdf-ac84-b20da846298f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:43.383965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c979-4c30-4fdf-ac84-b20da846298f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:43.384175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c979-4c30-4fdf-ac84-b20da846298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:43.476517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cf67c979-4c30-4fdf-ac84-b20da846298f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:43.478503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cf67c979-4c30-4fdf-ac84-b20da846298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:43.686389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 685/1378] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:44.115423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f3ee5-f138-4b00-a47a-5843b9001f93 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:44.117598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4f3f3ee5-f138-4b00-a47a-5843b9001f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:44.165734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:44.387081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f3ee5-f138-4b00-a47a-5843b9001f93 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:44.563385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:44.579753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c8413-9dff-422a-a71b-898cfec2bc98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:44.581131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c8413-9dff-422a-a71b-898cfec2bc98 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:44.581870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c8413-9dff-422a-a71b-898cfec2bc98 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:44.582264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c8413-9dff-422a-a71b-898cfec2bc98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:44.585539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-972c8413-9dff-422a-a71b-898cfec2bc98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:44.743789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c8413-9dff-422a-a71b-898cfec2bc98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:44.745646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c8413-9dff-422a-a71b-898cfec2bc98 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:44.770688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 694/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:24:47.444298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020777-5daf-471b-b792-fe471155c496 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:47.444816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020777-5daf-471b-b792-fe471155c496 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:47.444913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020777-5daf-471b-b792-fe471155c496 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:47.446295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 686/1380] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:47.452581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0f42c-8baa-48d0-bc44-d7366ed788a4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:47.453154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0f42c-8baa-48d0-bc44-d7366ed788a4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:47.453154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0f42c-8baa-48d0-bc44-d7366ed788a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:47.569085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f3b0f42c-8baa-48d0-bc44-d7366ed788a4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:47.571264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f3b0f42c-8baa-48d0-bc44-d7366ed788a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:47.696336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:47.773300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 695/1381] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:48.199714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020777-5daf-471b-b792-fe471155c496 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:48.202223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c8020777-5daf-471b-b792-fe471155c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:48.340829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:48.449665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020777-5daf-471b-b792-fe471155c496 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:48.632364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe02b4-d457-410a-bda3-5faad633b216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:48.633047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe02b4-d457-410a-bda3-5faad633b216 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:48.633350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe02b4-d457-410a-bda3-5faad633b216 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:48.633630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe02b4-d457-410a-bda3-5faad633b216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:48.635451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4dbe02b4-d457-410a-bda3-5faad633b216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:48.699645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:48.779315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe02b4-d457-410a-bda3-5faad633b216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:48.781772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe02b4-d457-410a-bda3-5faad633b216 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:48.811989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 687/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:24:52.099280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d45ac-b258-4a1a-a1dc-5f5c90022d74 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:52.099988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d45ac-b258-4a1a-a1dc-5f5c90022d74 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:52.100133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d45ac-b258-4a1a-a1dc-5f5c90022d74 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:52.102044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 696/1383] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:52.109992 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc82d7-327a-4e7a-9d79-e80d8138afff None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:52.110857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc82d7-327a-4e7a-9d79-e80d8138afff None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:52.111159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc82d7-327a-4e7a-9d79-e80d8138afff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:52.263780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7bfc82d7-327a-4e7a-9d79-e80d8138afff None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:52.265723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7bfc82d7-327a-4e7a-9d79-e80d8138afff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:52.399933 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 688/1384] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:52.742847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d45ac-b258-4a1a-a1dc-5f5c90022d74 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:52.746671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4c9d45ac-b258-4a1a-a1dc-5f5c90022d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:52.988309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d45ac-b258-4a1a-a1dc-5f5c90022d74 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:53.065048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:53.175239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87ab4-0031-48c8-8d6e-f067861f799f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:53.176337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87ab4-0031-48c8-8d6e-f067861f799f service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:53.176886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87ab4-0031-48c8-8d6e-f067861f799f service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:53.177323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87ab4-0031-48c8-8d6e-f067861f799f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:53.180247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0ae87ab4-0031-48c8-8d6e-f067861f799f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:53.333681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87ab4-0031-48c8-8d6e-f067861f799f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:53.336023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87ab4-0031-48c8-8d6e-f067861f799f service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:53.365580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 697/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:24:55.644092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572588-72f0-45ea-a474-41492f8e6ebd None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:55.645165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572588-72f0-45ea-a474-41492f8e6ebd None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:55.645635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00572588-72f0-45ea-a474-41492f8e6ebd None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:55.648295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 689/1386] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:55.656138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abaebc-dc69-4821-a409-a6d3cd021a01 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:55.656833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abaebc-dc69-4821-a409-a6d3cd021a01 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:55.657296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abaebc-dc69-4821-a409-a6d3cd021a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:55.768047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-10abaebc-dc69-4821-a409-a6d3cd021a01 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:55.769876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-10abaebc-dc69-4821-a409-a6d3cd021a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:55.772574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:55.943842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 698/1387] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:56.016102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea60a2-51e9-4331-a5ad-2736d5ac43f7 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:56.016479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea60a2-51e9-4331-a5ad-2736d5ac43f7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:56.016691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea60a2-51e9-4331-a5ad-2736d5ac43f7 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:56.018152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 690/1388] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:24:56.024946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e675613-054c-434d-bc88-d3dd89a1b1a6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:56.025256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e675613-054c-434d-bc88-d3dd89a1b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:56.025486 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e675613-054c-434d-bc88-d3dd89a1b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:56.105946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4e675613-054c-434d-bc88-d3dd89a1b1a6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:56.107164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4e675613-054c-434d-bc88-d3dd89a1b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:56.208453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:56.236564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 699/1389] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:24:56.239348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea60a2-51e9-4331-a5ad-2736d5ac43f7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:56.242204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d1ea60a2-51e9-4331-a5ad-2736d5ac43f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:56.275028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:56.470437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea60a2-51e9-4331-a5ad-2736d5ac43f7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:56.626290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:56.662790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:56.663967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:56.663967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:56.663967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:56.665724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:56.666070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5952-91cd-4f59-b7a3-b2b62c6e1467 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:56.666808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5952-91cd-4f59-b7a3-b2b62c6e1467 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:56.667031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5952-91cd-4f59-b7a3-b2b62c6e1467 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:56.669322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 700/1390] 10.222.0.55 () {54 vars in 966 bytes} [Tue Sep 13 12:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:56.677691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c966d98-a9a3-4a98-9328-3737b44e8881 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:56.678277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c966d98-a9a3-4a98-9328-3737b44e8881 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:56.678643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c966d98-a9a3-4a98-9328-3737b44e8881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:56.780999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9c966d98-a9a3-4a98-9328-3737b44e8881 None None] MFA Rules not processed for user `ac7ccabe29f4464bafbdd7b5aab7d775`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:56.782187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9c966d98-a9a3-4a98-9328-3737b44e8881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:56.797474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:56.799120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:56.821332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 691/1391] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:24:56.896787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 701/1392] 10.222.0.55 () {58 vars in 1063 bytes} [Tue Sep 13 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:56.906500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:56.907720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:57.015447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d727309-16a3-4d26-9ff8-22e9780cd55a service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:57.060470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:57.118492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647b0e0-e2c2-443c-84f1-7e74539c38aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7ccabe29f4464bafbdd7b5aab7d775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:57.119127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b0e0-e2c2-443c-84f1-7e74539c38aa service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:57.119405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b0e0-e2c2-443c-84f1-7e74539c38aa service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:57.119701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b0e0-e2c2-443c-84f1-7e74539c38aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:57.121542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0647b0e0-e2c2-443c-84f1-7e74539c38aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:57.260988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647b0e0-e2c2-443c-84f1-7e74539c38aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:57.262468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647b0e0-e2c2-443c-84f1-7e74539c38aa service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:57.285446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 692/1393] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:24:58.264819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bbe9b-4cb0-4cdf-9b2a-8d2f2c06d0a3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:58.265474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bbe9b-4cb0-4cdf-9b2a-8d2f2c06d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:58.265474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bbe9b-4cb0-4cdf-9b2a-8d2f2c06d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:58.344126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-321bbe9b-4cb0-4cdf-9b2a-8d2f2c06d0a3 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:58.345427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-321bbe9b-4cb0-4cdf-9b2a-8d2f2c06d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:58.378968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:58.456971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 702/1394] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:58.529667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a0db-8433-458f-bc1e-f859abe91bd2 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:58.530558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a0db-8433-458f-bc1e-f859abe91bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:58.530717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33a0db-8433-458f-bc1e-f859abe91bd2 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:58.532540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 693/1395] 10.222.0.55 () {54 vars in 943 bytes} [Tue Sep 13 12:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:24:58.542586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba4c7-d446-4299-8bee-d0f1ef92fbf6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:58.543071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba4c7-d446-4299-8bee-d0f1ef92fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:58.543474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ba4c7-d446-4299-8bee-d0f1ef92fbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:58.689478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-884ba4c7-d446-4299-8bee-d0f1ef92fbf6 None None] MFA Rules not processed for user `149aa4c99a33498282eb285ddebe89d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:58.691944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-884ba4c7-d446-4299-8bee-d0f1ef92fbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:58.867188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:58.870290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 703/1396] 10.222.0.55 () {58 vars in 1040 bytes} [Tue Sep 13 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:24:58.885865 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a0db-8433-458f-bc1e-f859abe91bd2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:24:58.887563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6c33a0db-8433-458f-bc1e-f859abe91bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:58.983006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:59.125987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33a0db-8433-458f-bc1e-f859abe91bd2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:24:59.281367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:24:59.282005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:59.282468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:59.282744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:59.284890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:59.346470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:24:59.391147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04684c-f5c5-4912-92ff-d6f8978f290a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:59.391738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04684c-f5c5-4912-92ff-d6f8978f290a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:59.391738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04684c-f5c5-4912-92ff-d6f8978f290a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:59.393036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 704/1397] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:24:59.393723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:24:59.396596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:24:59.399567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d0ca7-8e09-48d0-918a-192c40bc7af3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:24:59.399852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d0ca7-8e09-48d0-918a-192c40bc7af3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:24:59.400127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d0ca7-8e09-48d0-918a-192c40bc7af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:24:59.411607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 694/1398] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 12:24:59.511017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-111d0ca7-8e09-48d0-918a-192c40bc7af3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:24:59.512718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-111d0ca7-8e09-48d0-918a-192c40bc7af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:24:59.731002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 705/1399] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:25:00.198124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:00.200259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:00.362118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4767d-42c7-4507-b86c-a12b980171fc service swift] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:00.494516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:00.531129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb00d9-ad59-4485-8958-de4304cd589f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:00.532131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb00d9-ad59-4485-8958-de4304cd589f service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:00.532567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb00d9-ad59-4485-8958-de4304cd589f service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:00.532847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb00d9-ad59-4485-8958-de4304cd589f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:00.534708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7aeb00d9-ad59-4485-8958-de4304cd589f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:00.693562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb00d9-ad59-4485-8958-de4304cd589f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:00.695497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb00d9-ad59-4485-8958-de4304cd589f service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:00.735508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 695/1400] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:03.323627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7184d-0fdd-4fb8-be97-7705bf45f786 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:03.324229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7184d-0fdd-4fb8-be97-7705bf45f786 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:03.324742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7184d-0fdd-4fb8-be97-7705bf45f786 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:03.331579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 706/1401] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:25:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:03.333805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5924f-1e9b-4b96-84ad-e2fb27fcead8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:03.334689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5924f-1e9b-4b96-84ad-e2fb27fcead8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:03.335198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5924f-1e9b-4b96-84ad-e2fb27fcead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:03.421437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bcd5924f-1e9b-4b96-84ad-e2fb27fcead8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:03.422941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bcd5924f-1e9b-4b96-84ad-e2fb27fcead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:03.509026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:03.584610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 696/1402] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:03.969163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7184d-0fdd-4fb8-be97-7705bf45f786 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:03.970711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-78c7184d-0fdd-4fb8-be97-7705bf45f786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:04.082808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:04.183082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7184d-0fdd-4fb8-be97-7705bf45f786 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:04.360211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788ecfd-be2a-4a55-88a5-8a961b7ce22e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:04.361097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788ecfd-be2a-4a55-88a5-8a961b7ce22e service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:04.361097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788ecfd-be2a-4a55-88a5-8a961b7ce22e service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:04.361398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788ecfd-be2a-4a55-88a5-8a961b7ce22e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:04.363356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c788ecfd-be2a-4a55-88a5-8a961b7ce22e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:04.426155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:04.489459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788ecfd-be2a-4a55-88a5-8a961b7ce22e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:04.491242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788ecfd-be2a-4a55-88a5-8a961b7ce22e service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:04.515549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 707/1403] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:07.406230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df82c-4e32-4f55-8e51-3f5b57d6b0a4 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:07.407423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df82c-4e32-4f55-8e51-3f5b57d6b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:07.407954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df82c-4e32-4f55-8e51-3f5b57d6b0a4 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:07.410647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 697/1404] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:25:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:25:07.419984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ebadc-18d1-40e7-aba6-1d2fd81dbac8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:07.420593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ebadc-18d1-40e7-aba6-1d2fd81dbac8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:07.420929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ebadc-18d1-40e7-aba6-1d2fd81dbac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:07.546101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-429ebadc-18d1-40e7-aba6-1d2fd81dbac8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:07.547372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-429ebadc-18d1-40e7-aba6-1d2fd81dbac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:07.772439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 708/1405] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:08.206896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df82c-4e32-4f55-8e51-3f5b57d6b0a4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:08.208469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e87df82c-4e32-4f55-8e51-3f5b57d6b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:08.415695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df82c-4e32-4f55-8e51-3f5b57d6b0a4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:08.470328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:08.610095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfce7-707c-41d4-85b9-02efb26ef537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:08.611691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfce7-707c-41d4-85b9-02efb26ef537 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:08.612607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfce7-707c-41d4-85b9-02efb26ef537 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:08.613471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfce7-707c-41d4-85b9-02efb26ef537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:08.617346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-40fcfce7-707c-41d4-85b9-02efb26ef537 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:08.754577 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfce7-707c-41d4-85b9-02efb26ef537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:08.756344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfce7-707c-41d4-85b9-02efb26ef537 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:08.778897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 698/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:11.255576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945b02-e25e-464a-bc40-629cb7433d83 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:11.256378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945b02-e25e-464a-bc40-629cb7433d83 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:11.256378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945b02-e25e-464a-bc40-629cb7433d83 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:11.257566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 709/1407] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:11.263478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7721-2d00-4cc1-8bfe-b068e0a162b4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:11.264164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7721-2d00-4cc1-8bfe-b068e0a162b4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:11.264164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7721-2d00-4cc1-8bfe-b068e0a162b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:11.339096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:11.369366 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b9ce7721-2d00-4cc1-8bfe-b068e0a162b4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:11.370670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b9ce7721-2d00-4cc1-8bfe-b068e0a162b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:11.511572 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 699/1408] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:11.818979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26945b02-e25e-464a-bc40-629cb7433d83 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:11.819295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-26945b02-e25e-464a-bc40-629cb7433d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:11.845668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:12.072822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26945b02-e25e-464a-bc40-629cb7433d83 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:12.280724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:12.313773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee67aa-bf71-41d7-afc7-1b0fbb3fd8cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:12.314420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee67aa-bf71-41d7-afc7-1b0fbb3fd8cb service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:12.314739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee67aa-bf71-41d7-afc7-1b0fbb3fd8cb service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:12.315196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee67aa-bf71-41d7-afc7-1b0fbb3fd8cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:12.317877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-feee67aa-bf71-41d7-afc7-1b0fbb3fd8cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:12.441389 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee67aa-bf71-41d7-afc7-1b0fbb3fd8cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:12.443214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee67aa-bf71-41d7-afc7-1b0fbb3fd8cb service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:12.473344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 710/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:21.509749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=46 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:22.474471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=54 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:24.739275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fed5a-e8ee-4072-bb44-683154ee3ac5 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:24.739980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fed5a-e8ee-4072-bb44-683154ee3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:24.739980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fed5a-e8ee-4072-bb44-683154ee3ac5 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:24.741319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 700/1410] 10.222.0.55 () {54 vars in 918 bytes} [Tue Sep 13 12:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:25:24.747911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61810-3b02-4e90-b494-f0571fcddbc7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:24.748805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61810-3b02-4e90-b494-f0571fcddbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:24.748805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61810-3b02-4e90-b494-f0571fcddbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:24.865377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b8c61810-3b02-4e90-b494-f0571fcddbc7 None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:24.867340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b8c61810-3b02-4e90-b494-f0571fcddbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:25.052616 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 711/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Sep 13 12:25:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:25.074877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db252b-9a40-47f3-a4a5-9ceed91ecb52 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:25.075173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db252b-9a40-47f3-a4a5-9ceed91ecb52 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:25.075456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db252b-9a40-47f3-a4a5-9ceed91ecb52 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:25.076867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 701/1412] 10.222.0.55 () {54 vars in 918 bytes} [Tue Sep 13 12:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:25.082868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd2bc-e6c6-4817-a68b-9b6680f93ba9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:25.083184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd2bc-e6c6-4817-a68b-9b6680f93ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:25.083392 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd2bc-e6c6-4817-a68b-9b6680f93ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:25.217435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:25.224549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fe1cd2bc-e6c6-4817-a68b-9b6680f93ba9 None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:25.226346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fe1cd2bc-e6c6-4817-a68b-9b6680f93ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:25.375788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 712/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Sep 13 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:25:28.102027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18081dab-daef-44fc-a637-c0abda80b165 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:28.102616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18081dab-daef-44fc-a637-c0abda80b165 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:28.102616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18081dab-daef-44fc-a637-c0abda80b165 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:28.104027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:28.110305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db6c8-2bae-45cc-badd-03646a372780 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:28.111083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db6c8-2bae-45cc-badd-03646a372780 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:28.111083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db6c8-2bae-45cc-badd-03646a372780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:28.196494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-cb2db6c8-2bae-45cc-badd-03646a372780 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:28.197730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cb2db6c8-2bae-45cc-badd-03646a372780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:28.260782 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:28.313505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:25:28.607312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18081dab-daef-44fc-a637-c0abda80b165 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:28.609167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-18081dab-daef-44fc-a637-c0abda80b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:28.785773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18081dab-daef-44fc-a637-c0abda80b165 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:28.880439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:28.929613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae0c6c-f593-4c9b-a057-06a778162d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:28.930243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0c6c-f593-4c9b-a057-06a778162d25 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:28.930538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0c6c-f593-4c9b-a057-06a778162d25 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:28.930804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0c6c-f593-4c9b-a057-06a778162d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:28.932560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e3ae0c6c-f593-4c9b-a057-06a778162d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:29.041072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae0c6c-f593-4c9b-a057-06a778162d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:29.042738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae0c6c-f593-4c9b-a057-06a778162d25 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:29.068620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 703/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:30.340262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7f544-2ee5-4ed6-ab79-5cd5e6a3ea7c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:30.340956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7f544-2ee5-4ed6-ab79-5cd5e6a3ea7c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:30.340956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7f544-2ee5-4ed6-ab79-5cd5e6a3ea7c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:30.342178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:25:30.349801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e08ea-4dfd-4a64-a2ef-8ddb1f0b5bda None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:30.350636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e08ea-4dfd-4a64-a2ef-8ddb1f0b5bda None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:30.350844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e08ea-4dfd-4a64-a2ef-8ddb1f0b5bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:30.451967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f17e08ea-4dfd-4a64-a2ef-8ddb1f0b5bda None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:30.453248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f17e08ea-4dfd-4a64-a2ef-8ddb1f0b5bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:30.484031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:30.577735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:30.808424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7f544-2ee5-4ed6-ab79-5cd5e6a3ea7c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:30.810008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8ed7f544-2ee5-4ed6-ab79-5cd5e6a3ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:30.984052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7f544-2ee5-4ed6-ab79-5cd5e6a3ea7c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:31.036373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:31.118635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2bb88-c987-4921-9603-3f5336e19f03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:31.119154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2bb88-c987-4921-9603-3f5336e19f03 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:31.119432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2bb88-c987-4921-9603-3f5336e19f03 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:31.119702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2bb88-c987-4921-9603-3f5336e19f03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:31.121391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-18a2bb88-c987-4921-9603-3f5336e19f03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:31.226021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2bb88-c987-4921-9603-3f5336e19f03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:31.227712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2bb88-c987-4921-9603-3f5336e19f03 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:31.249094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 715/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:25:32.475431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aebd0e-38f1-401b-a4f9-dae0e1e3a782 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:32.476081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aebd0e-38f1-401b-a4f9-dae0e1e3a782 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:32.476448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aebd0e-38f1-401b-a4f9-dae0e1e3a782 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:32.478296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:25:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:32.488906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbefaa1-eb22-4532-9795-e4d2e23fefea None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:32.489508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbefaa1-eb22-4532-9795-e4d2e23fefea None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:32.489722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbefaa1-eb22-4532-9795-e4d2e23fefea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:32.567641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:32.596934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bcbefaa1-eb22-4532-9795-e4d2e23fefea None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:32.598242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bcbefaa1-eb22-4532-9795-e4d2e23fefea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:32.716274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:32.877875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aebd0e-38f1-401b-a4f9-dae0e1e3a782 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:32.880482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-47aebd0e-38f1-401b-a4f9-dae0e1e3a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:33.063751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aebd0e-38f1-401b-a4f9-dae0e1e3a782 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:33.078111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:33.200254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851afe41-3aa1-4e4e-9118-20913c022202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:33.200928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851afe41-3aa1-4e4e-9118-20913c022202 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:33.201207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851afe41-3aa1-4e4e-9118-20913c022202 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:33.201481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851afe41-3aa1-4e4e-9118-20913c022202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:33.203198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-851afe41-3aa1-4e4e-9118-20913c022202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:33.310647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851afe41-3aa1-4e4e-9118-20913c022202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:33.312425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851afe41-3aa1-4e4e-9118-20913c022202 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:33.336083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 706/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:34.622334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee39c3-4303-41ff-9144-6aa5e30bfef9 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:34.623087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee39c3-4303-41ff-9144-6aa5e30bfef9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:34.623087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee39c3-4303-41ff-9144-6aa5e30bfef9 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:34.624276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:34.631883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ad82-4f17-4717-9e0c-0a4e410ff489 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:34.632784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ad82-4f17-4717-9e0c-0a4e410ff489 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:34.632973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ad82-4f17-4717-9e0c-0a4e410ff489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:34.655634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:34.724832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-be93ad82-4f17-4717-9e0c-0a4e410ff489 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:34.728646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-be93ad82-4f17-4717-9e0c-0a4e410ff489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:34.856278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:35.011005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee39c3-4303-41ff-9144-6aa5e30bfef9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:35.012585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2dee39c3-4303-41ff-9144-6aa5e30bfef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:35.147223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:35.192764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee39c3-4303-41ff-9144-6aa5e30bfef9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:35.339642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b233c1-99dd-4132-bc4a-61483ddbf536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:35.340264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b233c1-99dd-4132-bc4a-61483ddbf536 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:35.340570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b233c1-99dd-4132-bc4a-61483ddbf536 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:35.340853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b233c1-99dd-4132-bc4a-61483ddbf536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:35.342549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b8b233c1-99dd-4132-bc4a-61483ddbf536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:35.433516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:35.449471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b233c1-99dd-4132-bc4a-61483ddbf536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:35.451138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b233c1-99dd-4132-bc4a-61483ddbf536 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:35.473216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 718/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:36.680274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb22b5c-b815-4ae6-bb4c-c047a83d9683 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:36.680870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb22b5c-b815-4ae6-bb4c-c047a83d9683 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:36.680870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb22b5c-b815-4ae6-bb4c-c047a83d9683 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:36.682665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:36.690872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f554bb-91d8-4e5b-8ed1-9f5270fea71a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:36.691464 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f554bb-91d8-4e5b-8ed1-9f5270fea71a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:36.691464 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f554bb-91d8-4e5b-8ed1-9f5270fea71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:36.780933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-42f554bb-91d8-4e5b-8ed1-9f5270fea71a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:36.782130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-42f554bb-91d8-4e5b-8ed1-9f5270fea71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:36.890314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:37.057363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb22b5c-b815-4ae6-bb4c-c047a83d9683 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:37.059046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6eb22b5c-b815-4ae6-bb4c-c047a83d9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:37.156213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:37.230430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb22b5c-b815-4ae6-bb4c-c047a83d9683 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:37.376810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c720a-99e4-411c-b508-2f8e9f8fd391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:37.377625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c720a-99e4-411c-b508-2f8e9f8fd391 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:37.378007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c720a-99e4-411c-b508-2f8e9f8fd391 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:37.378350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c720a-99e4-411c-b508-2f8e9f8fd391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:37.380159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-584c720a-99e4-411c-b508-2f8e9f8fd391 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:37.439770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:37.490624 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c720a-99e4-411c-b508-2f8e9f8fd391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:37.492526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c720a-99e4-411c-b508-2f8e9f8fd391 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:37.514275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 709/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:38.645707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0666-fee0-4722-9ea9-b4417f0edba4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:38.646495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0666-fee0-4722-9ea9-b4417f0edba4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:38.646495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0666-fee0-4722-9ea9-b4417f0edba4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:38.647605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:25:38.654850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722398d-601d-42be-943b-827aaea7bd9b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:38.655468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722398d-601d-42be-943b-827aaea7bd9b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:38.655468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722398d-601d-42be-943b-827aaea7bd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:38.753966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8722398d-601d-42be-943b-827aaea7bd9b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:38.755358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8722398d-601d-42be-943b-827aaea7bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:38.899359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:39.056269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0666-fee0-4722-9ea9-b4417f0edba4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:39.057931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3efc0666-fee0-4722-9ea9-b4417f0edba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:39.120226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:39.249967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0666-fee0-4722-9ea9-b4417f0edba4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:39.389274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9601eff-47a7-46f0-a7a2-24a4f516368c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:39.389907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601eff-47a7-46f0-a7a2-24a4f516368c service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:39.390191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601eff-47a7-46f0-a7a2-24a4f516368c service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:39.390460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601eff-47a7-46f0-a7a2-24a4f516368c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:39.392642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d9601eff-47a7-46f0-a7a2-24a4f516368c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:39.401147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:39.509910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9601eff-47a7-46f0-a7a2-24a4f516368c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:39.511478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9601eff-47a7-46f0-a7a2-24a4f516368c service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:39.535435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 721/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:40.659532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29ca1-59a6-4042-9d44-733cbe1a7217 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:40.660222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29ca1-59a6-4042-9d44-733cbe1a7217 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:40.660222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29ca1-59a6-4042-9d44-733cbe1a7217 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:40.661556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:40.670088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf74a65-48d2-4889-b45f-c2969c5a0fb4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:40.670647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf74a65-48d2-4889-b45f-c2969c5a0fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:40.671033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf74a65-48d2-4889-b45f-c2969c5a0fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:40.778658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bdf74a65-48d2-4889-b45f-c2969c5a0fb4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:40.779970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bdf74a65-48d2-4889-b45f-c2969c5a0fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:40.878447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:40.922365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:41.079280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29ca1-59a6-4042-9d44-733cbe1a7217 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:41.081623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8de29ca1-59a6-4042-9d44-733cbe1a7217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:41.103690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:41.299999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29ca1-59a6-4042-9d44-733cbe1a7217 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:41.399905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:41.431427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e720af9-01ad-4289-a15f-dfe9d18c70f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:41.432036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720af9-01ad-4289-a15f-dfe9d18c70f3 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:41.432312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720af9-01ad-4289-a15f-dfe9d18c70f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:41.432620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720af9-01ad-4289-a15f-dfe9d18c70f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:41.434271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6e720af9-01ad-4289-a15f-dfe9d18c70f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:41.548812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720af9-01ad-4289-a15f-dfe9d18c70f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:41.550628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720af9-01ad-4289-a15f-dfe9d18c70f3 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:41.571535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 712/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:42.711572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ffcd8-5e07-4241-9230-507e4f24db62 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:42.712302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ffcd8-5e07-4241-9230-507e4f24db62 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:42.712302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ffcd8-5e07-4241-9230-507e4f24db62 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:42.713521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:25:42.721215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c456-8f35-4d0f-bd7c-b9625e3f0c11 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:42.721810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c456-8f35-4d0f-bd7c-b9625e3f0c11 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:42.721939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c456-8f35-4d0f-bd7c-b9625e3f0c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:42.814628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fe81c456-8f35-4d0f-bd7c-b9625e3f0c11 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:42.816179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fe81c456-8f35-4d0f-bd7c-b9625e3f0c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:42.871087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:42.940716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:43.096566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ffcd8-5e07-4241-9230-507e4f24db62 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:43.097966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ed3ffcd8-5e07-4241-9230-507e4f24db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:43.320646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ffcd8-5e07-4241-9230-507e4f24db62 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:43.405619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:43.473808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29499b1e-c060-4d22-9a4e-008e3f9d2a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:43.474427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499b1e-c060-4d22-9a4e-008e3f9d2a58 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:43.474700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499b1e-c060-4d22-9a4e-008e3f9d2a58 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:43.474966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499b1e-c060-4d22-9a4e-008e3f9d2a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:43.476652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-29499b1e-c060-4d22-9a4e-008e3f9d2a58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:43.577760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29499b1e-c060-4d22-9a4e-008e3f9d2a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:43.579331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29499b1e-c060-4d22-9a4e-008e3f9d2a58 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:43.601050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 724/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:25:44.693175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241717d-2411-45a8-8809-4c2e3013e3ff None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:44.693797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241717d-2411-45a8-8809-4c2e3013e3ff None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:44.693797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241717d-2411-45a8-8809-4c2e3013e3ff None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:44.695198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:44.703612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a8ce-fa26-43bc-8744-17750273a945 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:44.704253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a8ce-fa26-43bc-8744-17750273a945 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:44.704585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a8ce-fa26-43bc-8744-17750273a945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:44.825606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2283a8ce-fa26-43bc-8744-17750273a945 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:44.826719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2283a8ce-fa26-43bc-8744-17750273a945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:44.829484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:44.945195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:45.102942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241717d-2411-45a8-8809-4c2e3013e3ff None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:45.104546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f241717d-2411-45a8-8809-4c2e3013e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:45.278230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241717d-2411-45a8-8809-4c2e3013e3ff None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:45.309595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:45.407111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cbdfb-bc50-4a25-9ab7-386c8b25b4dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:45.407846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cbdfb-bc50-4a25-9ab7-386c8b25b4dc service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:45.408337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cbdfb-bc50-4a25-9ab7-386c8b25b4dc service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:45.408642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cbdfb-bc50-4a25-9ab7-386c8b25b4dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:45.410374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ab0cbdfb-bc50-4a25-9ab7-386c8b25b4dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:45.518387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cbdfb-bc50-4a25-9ab7-386c8b25b4dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:45.520441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cbdfb-bc50-4a25-9ab7-386c8b25b4dc service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:45.544195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 715/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:47.747528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744ff6-a655-42d7-999b-c63775b797ac None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:47.748148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744ff6-a655-42d7-999b-c63775b797ac None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:47.748148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744ff6-a655-42d7-999b-c63775b797ac None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:47.749511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:47.755733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb149-dbac-4180-9692-ccb58f97eeb6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:47.756502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb149-dbac-4180-9692-ccb58f97eeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:47.756833 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb149-dbac-4180-9692-ccb58f97eeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:47.805979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:47.840804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c2ceb149-dbac-4180-9692-ccb58f97eeb6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:47.841940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c2ceb149-dbac-4180-9692-ccb58f97eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:47.953068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:48.241549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23744ff6-a655-42d7-999b-c63775b797ac None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:48.243131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-23744ff6-a655-42d7-999b-c63775b797ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:48.363473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23744ff6-a655-42d7-999b-c63775b797ac None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:48.400583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:48.445702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0929c7f-a491-4dca-bc56-f56c3187900d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:48.446345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929c7f-a491-4dca-bc56-f56c3187900d service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:48.446615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929c7f-a491-4dca-bc56-f56c3187900d service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:48.446903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929c7f-a491-4dca-bc56-f56c3187900d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:48.448574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b0929c7f-a491-4dca-bc56-f56c3187900d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:48.599284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0929c7f-a491-4dca-bc56-f56c3187900d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:48.600817 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0929c7f-a491-4dca-bc56-f56c3187900d service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:48.620969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 727/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:25:51.004551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd2f8-58f4-4559-a0fb-65262de00014 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:51.005326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd2f8-58f4-4559-a0fb-65262de00014 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:51.005326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd2f8-58f4-4559-a0fb-65262de00014 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:51.006568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:51.013028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5b52-2421-476c-8e9d-23908836a913 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:51.013771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5b52-2421-476c-8e9d-23908836a913 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:51.013771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5b52-2421-476c-8e9d-23908836a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:51.089261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-518b5b52-2421-476c-8e9d-23908836a913 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:51.090476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-518b5b52-2421-476c-8e9d-23908836a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:51.104865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:51.224424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:51.528238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bd2f8-58f4-4559-a0fb-65262de00014 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:51.529829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f57bd2f8-58f4-4559-a0fb-65262de00014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:51.665524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bd2f8-58f4-4559-a0fb-65262de00014 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:51.691433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:51.778850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67562a1-9def-465b-a408-f26428f486ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:51.779377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67562a1-9def-465b-a408-f26428f486ba service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:51.779644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67562a1-9def-465b-a408-f26428f486ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:51.779927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67562a1-9def-465b-a408-f26428f486ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:51.781652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e67562a1-9def-465b-a408-f26428f486ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:51.919680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67562a1-9def-465b-a408-f26428f486ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:51.921218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67562a1-9def-465b-a408-f26428f486ba service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:51.944877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 718/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:55.085274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586beb13-08a7-4fdf-bdfb-c23ac018ea89 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:55.086127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586beb13-08a7-4fdf-bdfb-c23ac018ea89 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:55.086127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586beb13-08a7-4fdf-bdfb-c23ac018ea89 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:55.087232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:55.093649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ea55-a987-4a69-a336-0370b1cd690f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:55.094254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ea55-a987-4a69-a336-0370b1cd690f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:55.094254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5ea55-a987-4a69-a336-0370b1cd690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:55.152570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:55.176990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-48d5ea55-a987-4a69-a336-0370b1cd690f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:55.178281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-48d5ea55-a987-4a69-a336-0370b1cd690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:55.299900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:25:55.593210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586beb13-08a7-4fdf-bdfb-c23ac018ea89 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:55.595061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-586beb13-08a7-4fdf-bdfb-c23ac018ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:55.736493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586beb13-08a7-4fdf-bdfb-c23ac018ea89 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:55.822892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:55.872241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e37dd-a916-4ace-8570-a8dbb2683d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:55.872915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e37dd-a916-4ace-8570-a8dbb2683d1d service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:55.873204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e37dd-a916-4ace-8570-a8dbb2683d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:55.873473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e37dd-a916-4ace-8570-a8dbb2683d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:55.875209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-994e37dd-a916-4ace-8570-a8dbb2683d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:56.016074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e37dd-a916-4ace-8570-a8dbb2683d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:56.018128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e37dd-a916-4ace-8570-a8dbb2683d1d service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:56.040028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 730/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:58.522165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269ee3-4402-4726-bf52-d15d5f2d430a None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:58.522812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269ee3-4402-4726-bf52-d15d5f2d430a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:58.523197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269ee3-4402-4726-bf52-d15d5f2d430a None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:58.525428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:58.532416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c297c-5b8b-4b7b-b667-1617595d7b50 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:58.533280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c297c-5b8b-4b7b-b667-1617595d7b50 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:58.533445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c297c-5b8b-4b7b-b667-1617595d7b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:58.618497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a46c297c-5b8b-4b7b-b667-1617595d7b50 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:58.619849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a46c297c-5b8b-4b7b-b667-1617595d7b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:58.647952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:58.756182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:59.055426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269ee3-4402-4726-bf52-d15d5f2d430a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:59.058191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-79269ee3-4402-4726-bf52-d15d5f2d430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:59.234462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269ee3-4402-4726-bf52-d15d5f2d430a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:59.259623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:59.323634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c6168-4664-48a2-a2f4-d4f426e7eb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:59.324155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6168-4664-48a2-a2f4-d4f426e7eb57 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:59.324444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6168-4664-48a2-a2f4-d4f426e7eb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:59.324730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6168-4664-48a2-a2f4-d4f426e7eb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:59.326431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0f0c6168-4664-48a2-a2f4-d4f426e7eb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:59.465136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c6168-4664-48a2-a2f4-d4f426e7eb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:59.466686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c6168-4664-48a2-a2f4-d4f426e7eb57 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:59.489455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 721/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:02.134301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8602d5-36cc-43be-b35b-26e161aac769 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:02.134911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8602d5-36cc-43be-b35b-26e161aac769 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:02.134911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8602d5-36cc-43be-b35b-26e161aac769 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:02.136203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:02.142666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c5095-f7a1-42ff-8e16-7ee72de25fc4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:02.143218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c5095-f7a1-42ff-8e16-7ee72de25fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:02.143352 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c5095-f7a1-42ff-8e16-7ee72de25fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:02.255490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:02.258885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d50c5095-f7a1-42ff-8e16-7ee72de25fc4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:02.260805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d50c5095-f7a1-42ff-8e16-7ee72de25fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:02.372954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:02.676350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8602d5-36cc-43be-b35b-26e161aac769 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:02.678026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4f8602d5-36cc-43be-b35b-26e161aac769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:02.812333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8602d5-36cc-43be-b35b-26e161aac769 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:02.881570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:02.913828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9d0f5-33de-4fd3-aaf4-f716cee3ed91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:02.914599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9d0f5-33de-4fd3-aaf4-f716cee3ed91 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:02.914972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9d0f5-33de-4fd3-aaf4-f716cee3ed91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:02.915446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9d0f5-33de-4fd3-aaf4-f716cee3ed91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:02.917309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1ed9d0f5-33de-4fd3-aaf4-f716cee3ed91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:03.092372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9d0f5-33de-4fd3-aaf4-f716cee3ed91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:03.095234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9d0f5-33de-4fd3-aaf4-f716cee3ed91 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:03.124357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 733/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:05.486383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0513f-65dc-4542-8237-14f0193fcb9b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:05.487056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0513f-65dc-4542-8237-14f0193fcb9b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:05.487056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0513f-65dc-4542-8237-14f0193fcb9b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:05.488824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:05.495287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b40d7-3cbf-4172-a4fd-bfd09d6fd7b4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:05.496163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b40d7-3cbf-4172-a4fd-bfd09d6fd7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:05.496163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b40d7-3cbf-4172-a4fd-bfd09d6fd7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:05.578005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e39b40d7-3cbf-4172-a4fd-bfd09d6fd7b4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:05.579375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e39b40d7-3cbf-4172-a4fd-bfd09d6fd7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:05.625224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:05.748075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:06.048346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0513f-65dc-4542-8237-14f0193fcb9b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:06.049893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c8d0513f-65dc-4542-8237-14f0193fcb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:06.170465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0513f-65dc-4542-8237-14f0193fcb9b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:06.208968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:06.270941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c18a1-5842-45a2-9c49-f802d9b11a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:06.271882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c18a1-5842-45a2-9c49-f802d9b11a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:06.272251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c18a1-5842-45a2-9c49-f802d9b11a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:06.272659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c18a1-5842-45a2-9c49-f802d9b11a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:06.274949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9f2c18a1-5842-45a2-9c49-f802d9b11a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:06.415975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c18a1-5842-45a2-9c49-f802d9b11a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:06.417486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c18a1-5842-45a2-9c49-f802d9b11a53 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:06.439451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 724/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:26:08.801862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9f946-0ce1-461b-ae0e-be405dbe7f4a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:08.802700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9f946-0ce1-461b-ae0e-be405dbe7f4a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:08.802700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9f946-0ce1-461b-ae0e-be405dbe7f4a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:08.803775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:26:08.810153 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cac3-7ad2-4403-b69d-bd60c39b8f9a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:08.810716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cac3-7ad2-4403-b69d-bd60c39b8f9a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:08.810716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cac3-7ad2-4403-b69d-bd60c39b8f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:08.905729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b127cac3-7ad2-4403-b69d-bd60c39b8f9a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:08.907158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b127cac3-7ad2-4403-b69d-bd60c39b8f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:08.917835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:09.177508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:26:09.473917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9f946-0ce1-461b-ae0e-be405dbe7f4a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:09.475827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c9f9f946-0ce1-461b-ae0e-be405dbe7f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:09.602741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9f946-0ce1-461b-ae0e-be405dbe7f4a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:09.667874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:09.699210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0e685-2d14-4eac-907a-1db8b9ac24e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:09.700249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e685-2d14-4eac-907a-1db8b9ac24e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:09.700765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e685-2d14-4eac-907a-1db8b9ac24e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:09.701214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e685-2d14-4eac-907a-1db8b9ac24e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:09.704865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-81e0e685-2d14-4eac-907a-1db8b9ac24e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:09.894549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0e685-2d14-4eac-907a-1db8b9ac24e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:09.896038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0e685-2d14-4eac-907a-1db8b9ac24e2 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:09.917866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 736/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:12.369946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f039-51df-4444-b877-0881ca9d32ee None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:12.370739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f039-51df-4444-b877-0881ca9d32ee None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:12.370739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f039-51df-4444-b877-0881ca9d32ee None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:12.371912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:12.381384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34b97-628d-4150-b997-47432e06218b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:12.381970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34b97-628d-4150-b997-47432e06218b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:12.381970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34b97-628d-4150-b997-47432e06218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:12.472684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0fe34b97-628d-4150-b997-47432e06218b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:12.473951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0fe34b97-628d-4150-b997-47432e06218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:12.521741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:12.600639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:12.898044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f039-51df-4444-b877-0881ca9d32ee None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:12.899871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b354f039-51df-4444-b877-0881ca9d32ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:13.051172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f039-51df-4444-b877-0881ca9d32ee None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:13.105672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:13.152105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc43c-3790-4631-8d62-340edb343750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:13.152657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc43c-3790-4631-8d62-340edb343750 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:13.152948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc43c-3790-4631-8d62-340edb343750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:13.153210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc43c-3790-4631-8d62-340edb343750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:13.154983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-03ccc43c-3790-4631-8d62-340edb343750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:13.299560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc43c-3790-4631-8d62-340edb343750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:13.301124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc43c-3790-4631-8d62-340edb343750 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:13.324918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 727/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:15.697701 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179dbb-1e45-48a3-a102-fac41f5d4a06 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:15.698276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179dbb-1e45-48a3-a102-fac41f5d4a06 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:15.698632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179dbb-1e45-48a3-a102-fac41f5d4a06 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:15.701186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:26:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:15.709365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c817e04-f914-4cb3-a1b3-f2c6c22b66af None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:15.710013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c817e04-f914-4cb3-a1b3-f2c6c22b66af None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:15.710370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c817e04-f914-4cb3-a1b3-f2c6c22b66af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:15.828733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0c817e04-f914-4cb3-a1b3-f2c6c22b66af None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:15.830275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0c817e04-f914-4cb3-a1b3-f2c6c22b66af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:15.854307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:15.972504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:16.483970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45179dbb-1e45-48a3-a102-fac41f5d4a06 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:16.485640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-45179dbb-1e45-48a3-a102-fac41f5d4a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:16.633634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45179dbb-1e45-48a3-a102-fac41f5d4a06 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:16.715425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:16.726484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce6fc2-7ce9-4592-9661-88fbb93139a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:16.727180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce6fc2-7ce9-4592-9661-88fbb93139a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:16.727502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce6fc2-7ce9-4592-9661-88fbb93139a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:16.727888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce6fc2-7ce9-4592-9661-88fbb93139a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:16.730071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-edce6fc2-7ce9-4592-9661-88fbb93139a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:16.871452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce6fc2-7ce9-4592-9661-88fbb93139a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:16.872995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce6fc2-7ce9-4592-9661-88fbb93139a1 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:16.897387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 739/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:19.223934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda056-c7e2-4763-bad6-e82b6bdbdc8b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:19.225255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda056-c7e2-4763-bad6-e82b6bdbdc8b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:19.225255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda056-c7e2-4763-bad6-e82b6bdbdc8b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:19.226379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:19.233055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9295-2222-4e3d-8172-7b00b02bd4d9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:19.233668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9295-2222-4e3d-8172-7b00b02bd4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:19.233668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9295-2222-4e3d-8172-7b00b02bd4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:19.321866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-abfb9295-2222-4e3d-8172-7b00b02bd4d9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:19.323131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-abfb9295-2222-4e3d-8172-7b00b02bd4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:19.383194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:19.469626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:19.754293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eda056-c7e2-4763-bad6-e82b6bdbdc8b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:19.755919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d8eda056-c7e2-4763-bad6-e82b6bdbdc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:19.873643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eda056-c7e2-4763-bad6-e82b6bdbdc8b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:19.928016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:19.955931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652dc0f-bad1-46dd-bd88-88735862553d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:19.956600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652dc0f-bad1-46dd-bd88-88735862553d service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:19.956898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652dc0f-bad1-46dd-bd88-88735862553d service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:19.957309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652dc0f-bad1-46dd-bd88-88735862553d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:19.959118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e652dc0f-bad1-46dd-bd88-88735862553d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:20.091238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652dc0f-bad1-46dd-bd88-88735862553d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:20.092800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652dc0f-bad1-46dd-bd88-88735862553d service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:20.116880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 730/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:29.467580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=22 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:30.114368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=66 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:41.348165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb67f7-3778-435b-b0f6-59893f28063f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:41.348776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb67f7-3778-435b-b0f6-59893f28063f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:41.348776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb67f7-3778-435b-b0f6-59893f28063f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:41.350045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 741/1471] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:41.357557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613e1a-e14a-42c1-bf50-bfd64a101809 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:41.358136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613e1a-e14a-42c1-bf50-bfd64a101809 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:41.358534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613e1a-e14a-42c1-bf50-bfd64a101809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:41.465157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4e613e1a-e14a-42c1-bf50-bfd64a101809 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:41.466432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4e613e1a-e14a-42c1-bf50-bfd64a101809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:41.598139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 731/1472] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:41.959531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8279a2-954e-4283-ae5e-61fd7634e05d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:41.959891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8279a2-954e-4283-ae5e-61fd7634e05d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:41.960200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8279a2-954e-4283-ae5e-61fd7634e05d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:41.961705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 742/1473] 10.222.0.55 () {54 vars in 966 bytes} [Tue Sep 13 12:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:41.968317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf803-69a1-47c2-ad50-97f96fc56bb5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:41.968753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf803-69a1-47c2-ad50-97f96fc56bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:41.969075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf803-69a1-47c2-ad50-97f96fc56bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:42.083031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bdecf803-69a1-47c2-ad50-97f96fc56bb5 None None] MFA Rules not processed for user `ac7ccabe29f4464bafbdd7b5aab7d775`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:42.084441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bdecf803-69a1-47c2-ad50-97f96fc56bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:42.111763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:42.179813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 732/1474] 10.222.0.55 () {58 vars in 1063 bytes} [Tue Sep 13 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:42.189566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8279a2-954e-4283-ae5e-61fd7634e05d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:42.191314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0c8279a2-954e-4283-ae5e-61fd7634e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:42.312813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8279a2-954e-4283-ae5e-61fd7634e05d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:42.409549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a7a7b-5131-4893-8e5a-5f4a67638e47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7ccabe29f4464bafbdd7b5aab7d775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:42.410546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a7a7b-5131-4893-8e5a-5f4a67638e47 service glance] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:42.410546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a7a7b-5131-4893-8e5a-5f4a67638e47 service glance] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:42.410835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a7a7b-5131-4893-8e5a-5f4a67638e47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:42.412422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-827a7a7b-5131-4893-8e5a-5f4a67638e47 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:42.482777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:42.548921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a7a7b-5131-4893-8e5a-5f4a67638e47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:42.550423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a7a7b-5131-4893-8e5a-5f4a67638e47 service glance] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:42.571501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 743/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:44.983348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93034e57-4266-429b-84bb-92871b0e644c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:44.984242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93034e57-4266-429b-84bb-92871b0e644c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:44.984242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93034e57-4266-429b-84bb-92871b0e644c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:44.985370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 733/1476] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:44.992793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e605-db2e-4932-a3b6-318cde25cbab None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:44.993384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e605-db2e-4932-a3b6-318cde25cbab None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:44.993784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e605-db2e-4932-a3b6-318cde25cbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:45.077047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b8c7e605-db2e-4932-a3b6-318cde25cbab None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:45.078258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b8c7e605-db2e-4932-a3b6-318cde25cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:45.191075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 744/1477] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:45.680986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93034e57-4266-429b-84bb-92871b0e644c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:45.683688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-93034e57-4266-429b-84bb-92871b0e644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:45.872195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93034e57-4266-429b-84bb-92871b0e644c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:45.934321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:45.987853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c2ef1-ea30-46a0-9adb-77b75947dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:45.988847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2ef1-ea30-46a0-9adb-77b75947dfcb admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:45.988847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2ef1-ea30-46a0-9adb-77b75947dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:45.989174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2ef1-ea30-46a0-9adb-77b75947dfcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:45.989659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c2ef1-ea30-46a0-9adb-77b75947dfcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:45.991589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING py.warnings [None req-a38c2ef1-ea30-46a0-9adb-77b75947dfcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:26:45.991589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: warnings.warn(msg) Sep 13 12:26:45.991589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: Sep 13 12:26:45.992785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c2ef1-ea30-46a0-9adb-77b75947dfcb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:46.015470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 734/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Tue Sep 13 12:26:45 2022] GET /identity/v3/projects => generated 2553 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:26:48.413997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac542a6a-c612-43f2-a823-ac216da921c3 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:48.414886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac542a6a-c612-43f2-a823-ac216da921c3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:48.414886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac542a6a-c612-43f2-a823-ac216da921c3 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:48.416423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 745/1479] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:48.423329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b0ea-20d7-4309-8e94-ea95888e12db None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:48.423894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b0ea-20d7-4309-8e94-ea95888e12db None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:48.423894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b0ea-20d7-4309-8e94-ea95888e12db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:48.516805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-39a6b0ea-20d7-4309-8e94-ea95888e12db None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:48.519258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-39a6b0ea-20d7-4309-8e94-ea95888e12db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:48.649388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 735/1480] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:48.954044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac542a6a-c612-43f2-a823-ac216da921c3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:48.956519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ac542a6a-c612-43f2-a823-ac216da921c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:48.968955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:49.140862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac542a6a-c612-43f2-a823-ac216da921c3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:49.244868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:49.284695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca8a5-3ae7-4230-bb28-6002df2d8d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:49.285383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca8a5-3ae7-4230-bb28-6002df2d8d9a service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:49.285666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca8a5-3ae7-4230-bb28-6002df2d8d9a service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:49.285932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca8a5-3ae7-4230-bb28-6002df2d8d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:49.287631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-eabca8a5-3ae7-4230-bb28-6002df2d8d9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:49.407948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca8a5-3ae7-4230-bb28-6002df2d8d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:49.411176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca8a5-3ae7-4230-bb28-6002df2d8d9a service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:49.442319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 746/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:26:52.027954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f0d6-f257-451e-a0a9-0e7f85c0ce0f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:52.028709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f0d6-f257-451e-a0a9-0e7f85c0ce0f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:52.028709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f0d6-f257-451e-a0a9-0e7f85c0ce0f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:52.030010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 736/1482] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:26:52.036615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f672018-5632-4e41-8fd9-aff2152b1f34 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:52.037252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f672018-5632-4e41-8fd9-aff2152b1f34 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:52.037252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f672018-5632-4e41-8fd9-aff2152b1f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:52.114602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2f672018-5632-4e41-8fd9-aff2152b1f34 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:52.115909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2f672018-5632-4e41-8fd9-aff2152b1f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:52.183409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:52.246543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 747/1483] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:52.535905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637f0d6-f257-451e-a0a9-0e7f85c0ce0f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:52.537526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f637f0d6-f257-451e-a0a9-0e7f85c0ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:52.565782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:52.659339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637f0d6-f257-451e-a0a9-0e7f85c0ce0f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:52.745817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10325ac-6814-48b8-b985-6b4ec566b9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:52.746433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10325ac-6814-48b8-b985-6b4ec566b9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:52.746711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10325ac-6814-48b8-b985-6b4ec566b9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:52.746982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10325ac-6814-48b8-b985-6b4ec566b9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:52.748672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a10325ac-6814-48b8-b985-6b4ec566b9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:52.839965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:52.882117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10325ac-6814-48b8-b985-6b4ec566b9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:52.883602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10325ac-6814-48b8-b985-6b4ec566b9e7 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:52.908227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 737/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:55.297252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00387bd-952e-4a36-acd1-188c7c031224 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:55.297980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00387bd-952e-4a36-acd1-188c7c031224 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:55.297980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00387bd-952e-4a36-acd1-188c7c031224 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:55.299480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 748/1485] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:55.306167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629aed0-9936-47f1-9b7f-104f724aa607 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:55.306790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629aed0-9936-47f1-9b7f-104f724aa607 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:55.306790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629aed0-9936-47f1-9b7f-104f724aa607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:55.394891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3629aed0-9936-47f1-9b7f-104f724aa607 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:55.396474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3629aed0-9936-47f1-9b7f-104f724aa607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:55.559633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 738/1486] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:55.874978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00387bd-952e-4a36-acd1-188c7c031224 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:55.876641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f00387bd-952e-4a36-acd1-188c7c031224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:56.019504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00387bd-952e-4a36-acd1-188c7c031224 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:56.165544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:56.168544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf533744-387f-4ea6-85bd-7c7d770daa70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:56.169897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533744-387f-4ea6-85bd-7c7d770daa70 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:56.170372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533744-387f-4ea6-85bd-7c7d770daa70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:56.171156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533744-387f-4ea6-85bd-7c7d770daa70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:56.174882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bf533744-387f-4ea6-85bd-7c7d770daa70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:56.385622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf533744-387f-4ea6-85bd-7c7d770daa70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:56.387382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf533744-387f-4ea6-85bd-7c7d770daa70 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:56.411963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 749/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:58.860826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b71e-a7f4-4804-bc22-97337eb4bb50 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:58.861435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b71e-a7f4-4804-bc22-97337eb4bb50 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:58.861435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b71e-a7f4-4804-bc22-97337eb4bb50 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:58.862698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 739/1488] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:26:58.869003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d329e-84da-4c49-9380-b96f37a7b394 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:58.869858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d329e-84da-4c49-9380-b96f37a7b394 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:58.869858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d329e-84da-4c49-9380-b96f37a7b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:58.961807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9e4d329e-84da-4c49-9380-b96f37a7b394 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:26:58.963835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9e4d329e-84da-4c49-9380-b96f37a7b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:59.041635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:59.095105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 750/1489] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:26:59.500657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97b71e-a7f4-4804-bc22-97337eb4bb50 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:59.502364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6b97b71e-a7f4-4804-bc22-97337eb4bb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:59.546180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:59.628192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97b71e-a7f4-4804-bc22-97337eb4bb50 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:59.724652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85202a63-aeec-4028-ac38-04aec6e59f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:59.725436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202a63-aeec-4028-ac38-04aec6e59f7b service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:59.725817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202a63-aeec-4028-ac38-04aec6e59f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:59.726189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202a63-aeec-4028-ac38-04aec6e59f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:59.728145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-85202a63-aeec-4028-ac38-04aec6e59f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:59.829061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:59.869591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85202a63-aeec-4028-ac38-04aec6e59f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:59.871606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85202a63-aeec-4028-ac38-04aec6e59f7b service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:59.900469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 740/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:27:02.971301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ae81-c084-4e50-a211-78b3923868a7 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:27:02.971895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ae81-c084-4e50-a211-78b3923868a7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:27:02.971895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ae81-c084-4e50-a211-78b3923868a7 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:27:02.973474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 751/1491] 10.222.0.55 () {54 vars in 927 bytes} [Tue Sep 13 12:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:27:02.979971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956b79-4f27-42ff-8d45-824514d9f045 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:27:02.980585 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956b79-4f27-42ff-8d45-824514d9f045 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:27:02.980585 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956b79-4f27-42ff-8d45-824514d9f045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:27:03.060896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-17956b79-4f27-42ff-8d45-824514d9f045 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:27:03.062621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-17956b79-4f27-42ff-8d45-824514d9f045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:03.185931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 741/1492] 10.222.0.55 () {58 vars in 1024 bytes} [Tue Sep 13 12:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:27:03.727727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38ae81-c084-4e50-a211-78b3923868a7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:27:03.729490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fd38ae81-c084-4e50-a211-78b3923868a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:03.926012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38ae81-c084-4e50-a211-78b3923868a7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:27:04.036915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d4f09-49a6-49d0-bb73-8a9d2dafad89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:27:04.037643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4f09-49a6-49d0-bb73-8a9d2dafad89 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:27:04.037899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4f09-49a6-49d0-bb73-8a9d2dafad89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:27:04.038212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4f09-49a6-49d0-bb73-8a9d2dafad89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:27:04.040216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-264d4f09-49a6-49d0-bb73-8a9d2dafad89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:27:04.051427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:27:04.209627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4f09-49a6-49d0-bb73-8a9d2dafad89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:27:04.211229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4f09-49a6-49d0-bb73-8a9d2dafad89 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:27:04.235468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 752/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:27:13.183335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=82 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:27:14.232372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=50 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:23.573261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24660f-5d7c-4e80-b731-4a66dce4c63b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:23.573708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24660f-5d7c-4e80-b731-4a66dce4c63b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:23.573812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24660f-5d7c-4e80-b731-4a66dce4c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:23.669965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0b24660f-5d7c-4e80-b731-4a66dce4c63b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:28:23.671244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0b24660f-5d7c-4e80-b731-4a66dce4c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:23.811831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 742/1494] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:28:23.821418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36573430-1e5b-407c-95cd-52435de41d22 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:23.822167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36573430-1e5b-407c-95cd-52435de41d22 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:23.822366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36573430-1e5b-407c-95cd-52435de41d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:23.854885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-36573430-1e5b-407c-95cd-52435de41d22 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:28:23.856961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-36573430-1e5b-407c-95cd-52435de41d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:23.871587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 753/1495] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:28:23.876710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24660f-5d7c-4e80-b731-4a66dce4c63b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:23.887449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24660f-5d7c-4e80-b731-4a66dce4c63b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:23.893938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:23.894726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:23.895119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:23.895444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:23.896194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:28:23.896602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:23.897821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING py.warnings [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:28:23.897821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: warnings.warn(msg) Sep 13 12:28:23.897821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: Sep 13 12:28:23.898890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:23.915394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 743/1496] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:28:23.925023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36573430-1e5b-407c-95cd-52435de41d22 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:23.935622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36573430-1e5b-407c-95cd-52435de41d22 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:23.941200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:23.941954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:23.942330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:23.942704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:23.943459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:23.945489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING py.warnings [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:28:23.945489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: warnings.warn(msg) Sep 13 12:28:23.945489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: Sep 13 12:28:23.946740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:23.993663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 754/1497] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:28:23 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:28:23.999056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:24.016639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197475-cd10-4490-ab22-08a0e1d22864 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:24.079367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:24.087819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:24.088502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.088792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.089065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.089744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:24.090819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING py.warnings [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:28:24.090819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: warnings.warn(msg) Sep 13 12:28:24.090819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: Sep 13 12:28:24.092070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:24.118126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 744/1498] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:28:23 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:28:24.123655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:24.135253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfb132-8863-4560-9f66-d733fa17d04c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:24.140353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:24.141037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.141317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.141591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.142594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:24.143642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING py.warnings [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:28:24.143642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: warnings.warn(msg) Sep 13 12:28:24.143642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: Sep 13 12:28:24.144583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:24.159150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 755/1499] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:28:24.164396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:24.175542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ec6f9-7568-43ee-87b7-9134189935e2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:24.181217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239a42-5eb5-441c-9103-5d78fd3c1d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:24.181862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239a42-5eb5-441c-9103-5d78fd3c1d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.182139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239a42-5eb5-441c-9103-5d78fd3c1d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.182411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239a42-5eb5-441c-9103-5d78fd3c1d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.183152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b239a42-5eb5-441c-9103-5d78fd3c1d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:24.184478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING py.warnings [None req-7b239a42-5eb5-441c-9103-5d78fd3c1d4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:28:24.184478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: warnings.warn(msg) Sep 13 12:28:24.184478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: Sep 13 12:28:24.185630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b239a42-5eb5-441c-9103-5d78fd3c1d4d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:24.201651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 745/1500] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:28:24.206788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:24.223931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b38a1e-9f38-4b3f-b015-83cc629ca47e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:24.230472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ffb2-1b16-48ff-ba6b-c1acae239114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:24.231272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ffb2-1b16-48ff-ba6b-c1acae239114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.231579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ffb2-1b16-48ff-ba6b-c1acae239114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.231894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ffb2-1b16-48ff-ba6b-c1acae239114 admin admin] PATH_INFO: `/v3/projects/c8f26aedf73847848ebbfb8956dacd27/users/88434dda502f401da9d43d2e0f4c6313/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.252714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ffb2-1b16-48ff-ba6b-c1acae239114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f26aedf73847848ebbfb8956dacd27, user_id=88434dda502f401da9d43d2e0f4c6313, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:24.254104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING py.warnings [None req-84f9ffb2-1b16-48ff-ba6b-c1acae239114 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:28:24.254104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: warnings.warn(msg) Sep 13 12:28:24.254104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: Sep 13 12:28:24.256348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ffb2-1b16-48ff-ba6b-c1acae239114 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:24.274214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 756/1501] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:28:24 2022] PUT /identity/v3/projects/c8f26aedf73847848ebbfb8956dacd27/users/88434dda502f401da9d43d2e0f4c6313/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:28:24.287540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1c19-79b4-4fe9-bffc-ef7f0b33fb47 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.287818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1c19-79b4-4fe9-bffc-ef7f0b33fb47 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.288090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1c19-79b4-4fe9-bffc-ef7f0b33fb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.319882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c38c1c19-79b4-4fe9-bffc-ef7f0b33fb47 None None] MFA Rules not processed for user `88434dda502f401da9d43d2e0f4c6313`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:28:24.321199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c38c1c19-79b4-4fe9-bffc-ef7f0b33fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:24.395629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 746/1502] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:28:24.410436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e797-50d5-4f40-a196-953ab632ff28 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.410878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e797-50d5-4f40-a196-953ab632ff28 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.411159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e797-50d5-4f40-a196-953ab632ff28 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.412927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 757/1503] 10.222.0.55 () {54 vars in 964 bytes} [Tue Sep 13 12:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:28:24.418537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1bcc-8e7f-4c70-bf22-2064da9bda07 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.418866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1bcc-8e7f-4c70-bf22-2064da9bda07 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.419208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1bcc-8e7f-4c70-bf22-2064da9bda07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.509046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b7dd1bcc-8e7f-4c70-bf22-2064da9bda07 None None] MFA Rules not processed for user `b7b8243a35594402943d956a93cda7b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:28:24.510392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b7dd1bcc-8e7f-4c70-bf22-2064da9bda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:24.603347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 747/1504] 10.222.0.55 () {58 vars in 1061 bytes} [Tue Sep 13 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:28:24.613670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e797-50d5-4f40-a196-953ab632ff28 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:24.625590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e797-50d5-4f40-a196-953ab632ff28 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:24.629718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924faa3-9aad-4557-bc73-955362e6ee6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:24.630358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924faa3-9aad-4557-bc73-955362e6ee6c service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.630674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924faa3-9aad-4557-bc73-955362e6ee6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.630906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924faa3-9aad-4557-bc73-955362e6ee6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.641239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924faa3-9aad-4557-bc73-955362e6ee6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:24.643187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924faa3-9aad-4557-bc73-955362e6ee6c service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:24.654890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 758/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:28:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:28:24.725232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e283a-2ccc-499e-9ab4-2faa3a3e154d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.725550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e283a-2ccc-499e-9ab4-2faa3a3e154d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.725780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e283a-2ccc-499e-9ab4-2faa3a3e154d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.727436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 748/1506] 10.222.0.55 () {52 vars in 830 bytes} [Tue Sep 13 12:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:28:24.734800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924faa3-9aad-4557-bc73-955362e6ee6c service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:24.829132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924faa3-9aad-4557-bc73-955362e6ee6c service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:24.834681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:24.835345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:24.835618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:24.835906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] PATH_INFO: `/v3/users/88434dda502f401da9d43d2e0f4c6313` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:24.837148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88434dda502f401da9d43d2e0f4c6313)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:24.838202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING py.warnings [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:28:24.838202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: warnings.warn(msg) Sep 13 12:28:24.838202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: Sep 13 12:28:24.839461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:24.927413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88434dda502f401da9d43d2e0f4c6313'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:24.956946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88434dda502f401da9d43d2e0f4c6313'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:24.970138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88434dda502f401da9d43d2e0f4c6313'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:24.970920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88434dda502f401da9d43d2e0f4c6313'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:24.971573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88434dda502f401da9d43d2e0f4c6313'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:24.985926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:25.002477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 759/1507] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:28:24 2022] DELETE /identity/v3/users/88434dda502f401da9d43d2e0f4c6313 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:28:25.010115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b53f3-61bf-4a34-b554-43969534529c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:25.010523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b53f3-61bf-4a34-b554-43969534529c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:25.010806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b53f3-61bf-4a34-b554-43969534529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:25.036578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-325b53f3-61bf-4a34-b554-43969534529c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:28:25.037875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-325b53f3-61bf-4a34-b554-43969534529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:25.052820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:25.138421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 749/1508] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:28:25.149247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:25.151065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:25.256454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767536-2b47-4068-8040-dccb911950d3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:25.260331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfd668-da84-49d8-8dec-b56285ee6d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:25.261005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfd668-da84-49d8-8dec-b56285ee6d24 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:25.261276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfd668-da84-49d8-8dec-b56285ee6d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:25.261600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfd668-da84-49d8-8dec-b56285ee6d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:25.273554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfd668-da84-49d8-8dec-b56285ee6d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:25.275565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfd668-da84-49d8-8dec-b56285ee6d24 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:25.287660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 760/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:28:25.881182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b53f3-61bf-4a34-b554-43969534529c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:28:25.883294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-325b53f3-61bf-4a34-b554-43969534529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:28:25.899821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b53f3-61bf-4a34-b554-43969534529c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:28:25.912375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:28:25.913088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:28:25.913376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:28:25.913635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] PATH_INFO: `/v3/projects/c8f26aedf73847848ebbfb8956dacd27` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:28:25.914889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f26aedf73847848ebbfb8956dacd27)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:28:25.915954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING py.warnings [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:28:25.915954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: warnings.warn(msg) Sep 13 12:28:25.915954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: Sep 13 12:28:25.917244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:28:25.986882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f26aedf73847848ebbfb8956dacd27', 'request_id': 'req-2cf82b60-3746-4adb-9405-e73ffbf6ecef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:26.005066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f26aedf73847848ebbfb8956dacd27', 'request_id': 'req-2cf82b60-3746-4adb-9405-e73ffbf6ecef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:26.018701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f26aedf73847848ebbfb8956dacd27', 'request_id': 'req-2cf82b60-3746-4adb-9405-e73ffbf6ecef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:26.033633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] The token cache is being invalidate because project c8f26aedf73847848ebbfb8956dacd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:28:26.034093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:26.035074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cf82b60-3746-4adb-9405-e73ffbf6ecef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:28:26.036873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 750/1510] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:28:25 2022] DELETE /identity/v3/projects/c8f26aedf73847848ebbfb8956dacd27 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:28:35.282632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=38 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:28:36.029947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:30:06.650654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe91ed-7684-44e1-ad66-532ec8485b54 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:06.651306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe91ed-7684-44e1-ad66-532ec8485b54 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:06.651455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe91ed-7684-44e1-ad66-532ec8485b54 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:06.653104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:30:06.659029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757867aa-b689-4222-8427-be28812cba2a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:06.659651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757867aa-b689-4222-8427-be28812cba2a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:06.659651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757867aa-b689-4222-8427-be28812cba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:06.681780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-757867aa-b689-4222-8427-be28812cba2a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:06.683021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-757867aa-b689-4222-8427-be28812cba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:06.762465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:06.922495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe91ed-7684-44e1-ad66-532ec8485b54 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:06.925549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6dfe91ed-7684-44e1-ad66-532ec8485b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:07.073634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe91ed-7684-44e1-ad66-532ec8485b54 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:07.080327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5e99b-4ef6-48d0-9654-ad7d2ba48663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:07.081007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5e99b-4ef6-48d0-9654-ad7d2ba48663 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:07.081288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5e99b-4ef6-48d0-9654-ad7d2ba48663 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:07.081560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5e99b-4ef6-48d0-9654-ad7d2ba48663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:07.093620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5e99b-4ef6-48d0-9654-ad7d2ba48663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:07.095332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5e99b-4ef6-48d0-9654-ad7d2ba48663 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:07.107482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 762/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:30:07.605870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934936b-76e6-4563-9eed-a5f47d28283f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:07.606267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934936b-76e6-4563-9eed-a5f47d28283f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:07.606676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934936b-76e6-4563-9eed-a5f47d28283f None None] PATH_INFO: `/v3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:07.608172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 752/1514] 10.222.0.70 () {54 vars in 925 bytes} [Tue Sep 13 12:30:07 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:30:07.616337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8509-25e6-4b23-8ae2-90bfc49f0af3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:07.616871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8509-25e6-4b23-8ae2-90bfc49f0af3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:07.617377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8509-25e6-4b23-8ae2-90bfc49f0af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:07.837816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3ada8509-25e6-4b23-8ae2-90bfc49f0af3 None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:07.839979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3ada8509-25e6-4b23-8ae2-90bfc49f0af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:07.970685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 763/1515] 10.222.0.70 () {58 vars in 1015 bytes} [Tue Sep 13 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:08.468045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89595-559c-4d26-a85f-ca4e719bc6f6 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:08.468830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89595-559c-4d26-a85f-ca4e719bc6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:08.468830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89595-559c-4d26-a85f-ca4e719bc6f6 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:08.470009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 753/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:30:08.478217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f566e-563e-4610-a0ce-c01749b98905 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:08.478679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f566e-563e-4610-a0ce-c01749b98905 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:08.478846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f566e-563e-4610-a0ce-c01749b98905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:08.502527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7a3f566e-563e-4610-a0ce-c01749b98905 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:08.503791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7a3f566e-563e-4610-a0ce-c01749b98905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:08.513183 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 764/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:08.794532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89595-559c-4d26-a85f-ca4e719bc6f6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:08.818082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89595-559c-4d26-a85f-ca4e719bc6f6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:08.827692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78ae6a-75f1-4010-a505-032533f70d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:08.828771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ae6a-75f1-4010-a505-032533f70d75 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:08.829231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ae6a-75f1-4010-a505-032533f70d75 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:08.829713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78ae6a-75f1-4010-a505-032533f70d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:08.843207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78ae6a-75f1-4010-a505-032533f70d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:08.844904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78ae6a-75f1-4010-a505-032533f70d75 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:08.855670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 754/1518] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:30:16.799128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b540-97c2-4af9-a7b5-8d11f5c941a7 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:16.799951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b540-97c2-4af9-a7b5-8d11f5c941a7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:16.799951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9b540-97c2-4af9-a7b5-8d11f5c941a7 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:16.801116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 765/1519] 10.222.0.55 () {54 vars in 961 bytes} [Tue Sep 13 12:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:30:16.811220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60915bba-d09f-437d-b64a-a6682b63f502 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:16.812012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60915bba-d09f-437d-b64a-a6682b63f502 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:16.812230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60915bba-d09f-437d-b64a-a6682b63f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:16.838643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-60915bba-d09f-437d-b64a-a6682b63f502 None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:16.840550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-60915bba-d09f-437d-b64a-a6682b63f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:16.853883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 755/1520] 10.222.0.55 () {58 vars in 1058 bytes} [Tue Sep 13 12:30:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:16.862099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9b540-97c2-4af9-a7b5-8d11f5c941a7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:16.877673 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9b540-97c2-4af9-a7b5-8d11f5c941a7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:16.887190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebde16-b1fa-4f52-91c8-5b4338d74d3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:16.888249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebde16-b1fa-4f52-91c8-5b4338d74d3a service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:16.888668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebde16-b1fa-4f52-91c8-5b4338d74d3a service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:16.889039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebde16-b1fa-4f52-91c8-5b4338d74d3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:16.902894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebde16-b1fa-4f52-91c8-5b4338d74d3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:16.905177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebde16-b1fa-4f52-91c8-5b4338d74d3a service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:16.922071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 766/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:30:20.490493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea6549-47e1-4f62-a955-b5540c07d275 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:20.491460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea6549-47e1-4f62-a955-b5540c07d275 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:20.491460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea6549-47e1-4f62-a955-b5540c07d275 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:20.493496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:30:20.502262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81131-ead4-413e-9fa4-70d5241bbe13 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:20.502935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81131-ead4-413e-9fa4-70d5241bbe13 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:20.503197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81131-ead4-413e-9fa4-70d5241bbe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:20.517701 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:30:20.535344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-91d81131-ead4-413e-9fa4-70d5241bbe13 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:20.536652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-91d81131-ead4-413e-9fa4-70d5241bbe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:20.546732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:20.713037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea6549-47e1-4f62-a955-b5540c07d275 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:20.734421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea6549-47e1-4f62-a955-b5540c07d275 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:20.740411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49968aa-ac4c-4849-aa98-bce368bc7891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:20.741119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49968aa-ac4c-4849-aa98-bce368bc7891 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:20.741341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49968aa-ac4c-4849-aa98-bce368bc7891 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:20.741612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49968aa-ac4c-4849-aa98-bce368bc7891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:20.751621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49968aa-ac4c-4849-aa98-bce368bc7891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:20.754115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49968aa-ac4c-4849-aa98-bce368bc7891 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:20.772030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 757/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:30:22.023902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50af8-8f69-4633-b38d-f6ecfddfa3c1 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:22.024570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50af8-8f69-4633-b38d-f6ecfddfa3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:22.024570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50af8-8f69-4633-b38d-f6ecfddfa3c1 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:22.025956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:30:22.033486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb6f91-97f7-4dfa-ac5b-7634ce926e6a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:22.034073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb6f91-97f7-4dfa-ac5b-7634ce926e6a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:22.034073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb6f91-97f7-4dfa-ac5b-7634ce926e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:22.057626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4dfb6f91-97f7-4dfa-ac5b-7634ce926e6a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:22.058915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4dfb6f91-97f7-4dfa-ac5b-7634ce926e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:22.068262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:22.227562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b50af8-8f69-4633-b38d-f6ecfddfa3c1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:22.243389 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b50af8-8f69-4633-b38d-f6ecfddfa3c1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:22.249343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cf2ff-a6e1-4dfd-b220-2439c0ad3584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:22.249970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cf2ff-a6e1-4dfd-b220-2439c0ad3584 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:22.250234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cf2ff-a6e1-4dfd-b220-2439c0ad3584 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:22.250512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cf2ff-a6e1-4dfd-b220-2439c0ad3584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:22.260689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cf2ff-a6e1-4dfd-b220-2439c0ad3584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:22.262675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cf2ff-a6e1-4dfd-b220-2439c0ad3584 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:22.274516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 769/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:30:26.851112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1dcc3-cc61-4673-8324-2129e6cfbdb6 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:26.852203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1dcc3-cc61-4673-8324-2129e6cfbdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:26.852203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1dcc3-cc61-4673-8324-2129e6cfbdb6 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:26.853351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:30:26.859432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0befb7-8e51-4276-9365-a9fc8955f80a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:26.860006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0befb7-8e51-4276-9365-a9fc8955f80a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:26.860006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0befb7-8e51-4276-9365-a9fc8955f80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:26.884857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3b0befb7-8e51-4276-9365-a9fc8955f80a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:26.886092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3b0befb7-8e51-4276-9365-a9fc8955f80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:26.894352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:27.185893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1dcc3-cc61-4673-8324-2129e6cfbdb6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:27.187989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0ee1dcc3-cc61-4673-8324-2129e6cfbdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:27.251421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1dcc3-cc61-4673-8324-2129e6cfbdb6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:27.255252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132486b8-5e71-4145-879f-297b0ffcaf7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:27.255992 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132486b8-5e71-4145-879f-297b0ffcaf7a service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:27.256310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132486b8-5e71-4145-879f-297b0ffcaf7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:27.256713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132486b8-5e71-4145-879f-297b0ffcaf7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:27.268483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132486b8-5e71-4145-879f-297b0ffcaf7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:27.270176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132486b8-5e71-4145-879f-297b0ffcaf7a service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:27.282324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 760/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:30:29.646820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df044e-80aa-4ece-81a6-20629fded77e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:29.647407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df044e-80aa-4ece-81a6-20629fded77e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:29.647407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df044e-80aa-4ece-81a6-20629fded77e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:29.649403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:30:29.656024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e730675-e17f-44fd-9c82-216e08235302 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:29.656735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e730675-e17f-44fd-9c82-216e08235302 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:29.657042 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e730675-e17f-44fd-9c82-216e08235302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:29.686396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2e730675-e17f-44fd-9c82-216e08235302 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:29.687641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2e730675-e17f-44fd-9c82-216e08235302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:29.696702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:30.221011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df044e-80aa-4ece-81a6-20629fded77e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:30.234425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df044e-80aa-4ece-81a6-20629fded77e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:30.238681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389ad8c-3146-45cd-8484-ec99331f9ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:30.239318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ad8c-3146-45cd-8484-ec99331f9ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:30.239584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ad8c-3146-45cd-8484-ec99331f9ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:30.239859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ad8c-3146-45cd-8484-ec99331f9ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:30.250481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389ad8c-3146-45cd-8484-ec99331f9ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:30.251962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389ad8c-3146-45cd-8484-ec99331f9ee3 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:30.263253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 772/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:30:34.899295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb378b9a-6e8b-4ae4-8ef0-c40a71bdcdfe None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:34.900087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb378b9a-6e8b-4ae4-8ef0-c40a71bdcdfe None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:34.900087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb378b9a-6e8b-4ae4-8ef0-c40a71bdcdfe None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:34.901741 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:30:34.908594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d6b7-9d77-4a72-ad15-b3db2911502d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:34.909199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d6b7-9d77-4a72-ad15-b3db2911502d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:34.909199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d6b7-9d77-4a72-ad15-b3db2911502d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:34.942554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7d77d6b7-9d77-4a72-ad15-b3db2911502d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:34.943986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7d77d6b7-9d77-4a72-ad15-b3db2911502d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:34.955892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:35.262587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb378b9a-6e8b-4ae4-8ef0-c40a71bdcdfe None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:35.264414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cb378b9a-6e8b-4ae4-8ef0-c40a71bdcdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:35.338430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb378b9a-6e8b-4ae4-8ef0-c40a71bdcdfe None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:35.344651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60b4f4-9ebd-4943-ae1a-6d19ca63e780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:35.345711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60b4f4-9ebd-4943-ae1a-6d19ca63e780 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:35.346168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60b4f4-9ebd-4943-ae1a-6d19ca63e780 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:35.346617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60b4f4-9ebd-4943-ae1a-6d19ca63e780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:35.360714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60b4f4-9ebd-4943-ae1a-6d19ca63e780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:35.362243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60b4f4-9ebd-4943-ae1a-6d19ca63e780 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:35.369072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:30:35.380677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 763/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:30:37.794357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893297b-4180-4214-a0c6-35bacfca2307 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:37.794945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893297b-4180-4214-a0c6-35bacfca2307 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:37.794945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893297b-4180-4214-a0c6-35bacfca2307 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:37.796256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:30:37.804742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eba26-527a-483d-8777-5147dc71f97c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:37.805407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eba26-527a-483d-8777-5147dc71f97c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:37.805879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eba26-527a-483d-8777-5147dc71f97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:37.836423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e15eba26-527a-483d-8777-5147dc71f97c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:30:37.838102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e15eba26-527a-483d-8777-5147dc71f97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:37.854341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:30:38.187723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893297b-4180-4214-a0c6-35bacfca2307 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:38.189781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2893297b-4180-4214-a0c6-35bacfca2307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:38.204729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893297b-4180-4214-a0c6-35bacfca2307 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:38.209528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866768bb-3e13-460d-b8e0-b9236650da16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:38.211768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866768bb-3e13-460d-b8e0-b9236650da16 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:38.212159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866768bb-3e13-460d-b8e0-b9236650da16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:38.212584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866768bb-3e13-460d-b8e0-b9236650da16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:38.226096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866768bb-3e13-460d-b8e0-b9236650da16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:38.229015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866768bb-3e13-460d-b8e0-b9236650da16 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:38.244406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 775/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:30:47.827906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:30:48.236847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=26 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:10.966073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814362-aaca-45eb-b7de-be3338cb2d16 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:10.966764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814362-aaca-45eb-b7de-be3338cb2d16 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:10.966863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814362-aaca-45eb-b7de-be3338cb2d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.010021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d0814362-aaca-45eb-b7de-be3338cb2d16 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.012214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d0814362-aaca-45eb-b7de-be3338cb2d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.030180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 765/1540] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:11.041548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ceb20-1271-40e8-8083-d322488b873b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.042205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ceb20-1271-40e8-8083-d322488b873b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.042494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ceb20-1271-40e8-8083-d322488b873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.091651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e98ceb20-1271-40e8-8083-d322488b873b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.094004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e98ceb20-1271-40e8-8083-d322488b873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.117648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 776/1541] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:11.127289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0814362-aaca-45eb-b7de-be3338cb2d16 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:11.158909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0814362-aaca-45eb-b7de-be3338cb2d16 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:11.175989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf020-5caf-48e1-a7fd-d23023ce3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:11.178432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf020-5caf-48e1-a7fd-d23023ce3069 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.178925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf020-5caf-48e1-a7fd-d23023ce3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.179365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf020-5caf-48e1-a7fd-d23023ce3069 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.180644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf020-5caf-48e1-a7fd-d23023ce3069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:11.181193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf020-5caf-48e1-a7fd-d23023ce3069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:11.184367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf020-5caf-48e1-a7fd-d23023ce3069 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:11.219491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 766/1542] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:11.231861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ceb20-1271-40e8-8083-d322488b873b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:11.267664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ceb20-1271-40e8-8083-d322488b873b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:11.287863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283398ca-fabe-4bc9-8c81-a247f984910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:11.289057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283398ca-fabe-4bc9-8c81-a247f984910e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.289530 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283398ca-fabe-4bc9-8c81-a247f984910e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.289981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283398ca-fabe-4bc9-8c81-a247f984910e admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.291040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283398ca-fabe-4bc9-8c81-a247f984910e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:11.295382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283398ca-fabe-4bc9-8c81-a247f984910e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:11.354833 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc40cde-9607-4f85-b28a-3c202c85f0cc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.355098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 777/1543] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:11.355200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc40cde-9607-4f85-b28a-3c202c85f0cc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.356638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc40cde-9607-4f85-b28a-3c202c85f0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.361292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283398ca-fabe-4bc9-8c81-a247f984910e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:11.430591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dfc40cde-9607-4f85-b28a-3c202c85f0cc None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.433106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dfc40cde-9607-4f85-b28a-3c202c85f0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.470277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283398ca-fabe-4bc9-8c81-a247f984910e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:11.506109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5cec3-015b-4e80-ba93-9dcd69111d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:11.507176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5cec3-015b-4e80-ba93-9dcd69111d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.507664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5cec3-015b-4e80-ba93-9dcd69111d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.508089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5cec3-015b-4e80-ba93-9dcd69111d86 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.509265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5cec3-015b-4e80-ba93-9dcd69111d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:11.512827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING py.warnings [None req-74e5cec3-015b-4e80-ba93-9dcd69111d86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:32:11.512827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: warnings.warn(msg) Sep 13 12:32:11.512827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: Sep 13 12:32:11.520212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5cec3-015b-4e80-ba93-9dcd69111d86 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:11.593848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 778/1544] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:11.596260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b0e3-7b97-41cd-8950-8955bad68878 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.597243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b0e3-7b97-41cd-8950-8955bad68878 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.597243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b0e3-7b97-41cd-8950-8955bad68878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.702902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4fd9b0e3-7b97-41cd-8950-8955bad68878 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.702902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4fd9b0e3-7b97-41cd-8950-8955bad68878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.708264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 767/1545] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:11.710863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461001-0a43-42a5-8b37-79ff2c5bafc7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.711662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461001-0a43-42a5-8b37-79ff2c5bafc7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.712233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461001-0a43-42a5-8b37-79ff2c5bafc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.736080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 779/1546] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:11.738866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9b0e3-7b97-41cd-8950-8955bad68878 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:11.782614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fb461001-0a43-42a5-8b37-79ff2c5bafc7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.784918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fb461001-0a43-42a5-8b37-79ff2c5bafc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.787025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9b0e3-7b97-41cd-8950-8955bad68878 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:11.803883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549d0e3-124b-4162-a4e4-f4be6059768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:11.805670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d0e3-124b-4162-a4e4-f4be6059768a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.806164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d0e3-124b-4162-a4e4-f4be6059768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.806817 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d0e3-124b-4162-a4e4-f4be6059768a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.812126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549d0e3-124b-4162-a4e4-f4be6059768a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:11.816120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549d0e3-124b-4162-a4e4-f4be6059768a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:11.823067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 768/1547] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:11.825500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd822-1c52-4cc5-b35f-a58f238774b1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.825993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd822-1c52-4cc5-b35f-a58f238774b1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.826457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd822-1c52-4cc5-b35f-a58f238774b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.859395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 780/1548] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:11.862826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5879e-36af-4dc8-b01f-a4d3e8e53c5a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.863308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5879e-36af-4dc8-b01f-a4d3e8e53c5a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.863816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5879e-36af-4dc8-b01f-a4d3e8e53c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.872093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-360cd822-1c52-4cc5-b35f-a58f238774b1 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.875038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-360cd822-1c52-4cc5-b35f-a58f238774b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.894666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 769/1549] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:11.897875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fadff5-0c1d-4ebb-84a3-2ed5a20bd00d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.898350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fadff5-0c1d-4ebb-84a3-2ed5a20bd00d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.898821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fadff5-0c1d-4ebb-84a3-2ed5a20bd00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.916830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4ca5879e-36af-4dc8-b01f-a4d3e8e53c5a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.918743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4ca5879e-36af-4dc8-b01f-a4d3e8e53c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.929804 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 781/1550] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:11.931516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110aec0-1660-4904-a4f0-52cc23efb233 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.932050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110aec0-1660-4904-a4f0-52cc23efb233 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.932838 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110aec0-1660-4904-a4f0-52cc23efb233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.934525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c2fadff5-0c1d-4ebb-84a3-2ed5a20bd00d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.936725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c2fadff5-0c1d-4ebb-84a3-2ed5a20bd00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.949928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 770/1551] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:11.952429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edef0ee-dac3-4992-aea0-ebc4de8bcdac None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.954123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edef0ee-dac3-4992-aea0-ebc4de8bcdac None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.954123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edef0ee-dac3-4992-aea0-ebc4de8bcdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.956596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e110aec0-1660-4904-a4f0-52cc23efb233 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.958078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e110aec0-1660-4904-a4f0-52cc23efb233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:11.966665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 782/1552] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:11.967760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110aec0-1660-4904-a4f0-52cc23efb233 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:11.979794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110aec0-1660-4904-a4f0-52cc23efb233 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:11.984608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ff7da-7ec3-4dd0-ba2a-1989e0777f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:11.985304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff7da-7ec3-4dd0-ba2a-1989e0777f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:11.985543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff7da-7ec3-4dd0-ba2a-1989e0777f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:11.985816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff7da-7ec3-4dd0-ba2a-1989e0777f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:11.986479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ff7da-7ec3-4dd0-ba2a-1989e0777f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:11.988291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ff7da-7ec3-4dd0-ba2a-1989e0777f34 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:11.992426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9edef0ee-dac3-4992-aea0-ebc4de8bcdac None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:11.994812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9edef0ee-dac3-4992-aea0-ebc4de8bcdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.001498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 783/1553] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:12.006128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902d17-9ae0-4314-863b-2b4800f54a00 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.006437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902d17-9ae0-4314-863b-2b4800f54a00 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.006762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6902d17-9ae0-4314-863b-2b4800f54a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.011809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 771/1554] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:12.015490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703f01-e373-4410-a153-2bfde94cb582 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.015965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703f01-e373-4410-a153-2bfde94cb582 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.016445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703f01-e373-4410-a153-2bfde94cb582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.033802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f6902d17-9ae0-4314-863b-2b4800f54a00 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:12.035097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f6902d17-9ae0-4314-863b-2b4800f54a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.044521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 784/1555] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:12.048006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6902d17-9ae0-4314-863b-2b4800f54a00 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.060108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6902d17-9ae0-4314-863b-2b4800f54a00 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.062189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cf703f01-e373-4410-a153-2bfde94cb582 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:12.064064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cf703f01-e373-4410-a153-2bfde94cb582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.065237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.065869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.066177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.066521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.067276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:12.067568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.068648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING py.warnings [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:32:12.068648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: warnings.warn(msg) Sep 13 12:32:12.068648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: Sep 13 12:32:12.069552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.082471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 785/1556] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:12.083742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.085540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 772/1557] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:12.086950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703f01-e373-4410-a153-2bfde94cb582 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.103009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61568c8e-86a0-4f66-a6e5-757fd61be976 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.107607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703f01-e373-4410-a153-2bfde94cb582 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.111400 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff841ba-183a-4987-8ca3-77c675cab885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.113871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff841ba-183a-4987-8ca3-77c675cab885 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.114428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff841ba-183a-4987-8ca3-77c675cab885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.114825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.115468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.115757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.115951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff841ba-183a-4987-8ca3-77c675cab885 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.116063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.116826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:12.117275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.117768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff841ba-183a-4987-8ca3-77c675cab885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:12.118136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff841ba-183a-4987-8ca3-77c675cab885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.119213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.120205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff841ba-183a-4987-8ca3-77c675cab885 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.135043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 773/1558] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:12.135915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.148457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 786/1559] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:12.148457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9a43-258f-464d-8783-50ba9fa0ffb9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.148457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9a43-258f-464d-8783-50ba9fa0ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.148457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9a43-258f-464d-8783-50ba9fa0ffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.153344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edd776-99a4-4556-bca5-a3add101aaf0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.158952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.161060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.161389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.161754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] PATH_INFO: `/v3/projects/4a3e1ffdc05e471ab0daeb978e81e291/users/452b906a5338428d8fc824ddff2093e8/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.176660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5fcd9a43-258f-464d-8783-50ba9fa0ffb9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:12.179554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5fcd9a43-258f-464d-8783-50ba9fa0ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.184663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3e1ffdc05e471ab0daeb978e81e291, user_id=452b906a5338428d8fc824ddff2093e8, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.186173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING py.warnings [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:32:12.186173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: warnings.warn(msg) Sep 13 12:32:12.186173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: Sep 13 12:32:12.188805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.189800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 787/1560] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:12.191246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8c8eb-9b88-49c9-89f2-ee6ceee63ba2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.191868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8c8eb-9b88-49c9-89f2-ee6ceee63ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.192162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8c8eb-9b88-49c9-89f2-ee6ceee63ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.219135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0cc8c8eb-9b88-49c9-89f2-ee6ceee63ba2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:12.220904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 774/1561] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:12 2022] PUT /identity/v3/projects/4a3e1ffdc05e471ab0daeb978e81e291/users/452b906a5338428d8fc824ddff2093e8/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:12.221259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0cc8c8eb-9b88-49c9-89f2-ee6ceee63ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.221670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.266004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:12.300955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 788/1562] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:12.302460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8c8eb-9b88-49c9-89f2-ee6ceee63ba2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.318673 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8c8eb-9b88-49c9-89f2-ee6ceee63ba2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.323799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1613-17df-4365-9a3a-013d555710af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.324492 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1613-17df-4365-9a3a-013d555710af admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.324775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1613-17df-4365-9a3a-013d555710af admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.325049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1613-17df-4365-9a3a-013d555710af admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.325699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1613-17df-4365-9a3a-013d555710af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.327686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1613-17df-4365-9a3a-013d555710af admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.328585 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c6b73-45b8-498b-a264-31fcc0c388d2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.336008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.336955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.337354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.337730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.338669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:12.339111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.341695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.364572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 789/1563] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:12.364889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 775/1564] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:12.365041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc25e5-6a6f-447c-a567-63694a04246a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.365041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc25e5-6a6f-447c-a567-63694a04246a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.365041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc25e5-6a6f-447c-a567-63694a04246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.365437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.380665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:12.385153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dbdc25e5-6a6f-447c-a567-63694a04246a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:12.386428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dbdc25e5-6a6f-447c-a567-63694a04246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.388802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450ce5e-f86c-4c73-9820-752928bdca58 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.472182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 790/1565] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:12.473176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc25e5-6a6f-447c-a567-63694a04246a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.484945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc25e5-6a6f-447c-a567-63694a04246a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.486939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a318f2-7588-4e17-8a61-71380d47782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.487584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a318f2-7588-4e17-8a61-71380d47782c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.487870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a318f2-7588-4e17-8a61-71380d47782c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.488141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a318f2-7588-4e17-8a61-71380d47782c admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.489162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a318f2-7588-4e17-8a61-71380d47782c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.490738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING py.warnings [None req-84a318f2-7588-4e17-8a61-71380d47782c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:32:12.490738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: warnings.warn(msg) Sep 13 12:32:12.490738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: Sep 13 12:32:12.491981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a318f2-7588-4e17-8a61-71380d47782c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.492417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8c0c1-0119-4db9-97aa-778d7326692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.493483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8c0c1-0119-4db9-97aa-778d7326692f admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.493984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8c0c1-0119-4db9-97aa-778d7326692f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.494484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8c0c1-0119-4db9-97aa-778d7326692f admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.495603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8c0c1-0119-4db9-97aa-778d7326692f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.499378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8c0c1-0119-4db9-97aa-778d7326692f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.532807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 776/1566] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:12.532807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187639a-c7be-4096-af84-ff5543890681 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.532807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187639a-c7be-4096-af84-ff5543890681 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.532807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187639a-c7be-4096-af84-ff5543890681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.548474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 791/1567] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:12.549908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fcd5e-2cc4-4b13-9afc-cd0d1c924db5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.550200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fcd5e-2cc4-4b13-9afc-cd0d1c924db5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.550475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fcd5e-2cc4-4b13-9afc-cd0d1c924db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.563130 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5187639a-c7be-4096-af84-ff5543890681 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:12.565566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5187639a-c7be-4096-af84-ff5543890681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.572545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1d2fcd5e-2cc4-4b13-9afc-cd0d1c924db5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:12.574498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1d2fcd5e-2cc4-4b13-9afc-cd0d1c924db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.662005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 792/1568] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:12.662931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fcd5e-2cc4-4b13-9afc-cd0d1c924db5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.674488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 777/1569] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:12.676049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187639a-c7be-4096-af84-ff5543890681 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.678104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fcd5e-2cc4-4b13-9afc-cd0d1c924db5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.691175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.693219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.694458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.694914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.696046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:12.696556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.699383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.701103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187639a-c7be-4096-af84-ff5543890681 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.707661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f87e7-a6f0-44b5-8998-cccb9a30eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.708302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f87e7-a6f0-44b5-8998-cccb9a30eb74 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.708597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f87e7-a6f0-44b5-8998-cccb9a30eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.708882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f87e7-a6f0-44b5-8998-cccb9a30eb74 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.709564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f87e7-a6f0-44b5-8998-cccb9a30eb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.712316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f87e7-a6f0-44b5-8998-cccb9a30eb74 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.718642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 793/1570] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:12.719803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.736614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f468a-cfeb-4630-8e4c-dd9dc9ed18e4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.743174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 778/1571] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/users => generated 288 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:12.743486 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df825ee-1fef-44db-930a-48c6b5f7cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.744363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df825ee-1fef-44db-930a-48c6b5f7cdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.744576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f87e7-a6f0-44b5-8998-cccb9a30eb74 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.744835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df825ee-1fef-44db-930a-48c6b5f7cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.745255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df825ee-1fef-44db-930a-48c6b5f7cdf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.746317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df825ee-1fef-44db-930a-48c6b5f7cdf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.748454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df825ee-1fef-44db-930a-48c6b5f7cdf6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.761590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f87e7-a6f0-44b5-8998-cccb9a30eb74 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.769500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.771081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.771582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.771968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.773140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:12.773580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.776443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.784497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 794/1572] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:12.785027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df825ee-1fef-44db-930a-48c6b5f7cdf6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.791030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:12.797225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 779/1573] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:12.798098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.824334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a100-365f-40ea-8b1f-7e798a8615a1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.892187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649de98c-624f-4cd0-96ca-14968d63eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.892857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649de98c-624f-4cd0-96ca-14968d63eec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.893148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649de98c-624f-4cd0-96ca-14968d63eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.893427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649de98c-624f-4cd0-96ca-14968d63eec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.894066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649de98c-624f-4cd0-96ca-14968d63eec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.895409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df825ee-1fef-44db-930a-48c6b5f7cdf6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.896766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649de98c-624f-4cd0-96ca-14968d63eec9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.901661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.902654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.903150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.903644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.904845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.906963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:12.908767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.927747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 780/1574] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:12.929927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649de98c-624f-4cd0-96ca-14968d63eec9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.944567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 795/1575] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:12.946255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:12.948575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:12.952762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649de98c-624f-4cd0-96ca-14968d63eec9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:12.961188 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:12.962224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:12.962680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:12.963162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:12.964341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:12.964933 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:12.968114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:12.990955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 781/1576] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:12.991922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.006444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ddebe-34ab-41d1-8676-8509a0d9a239 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.013307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99256f34-cbae-491c-938a-a891dc4d6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.014299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99256f34-cbae-491c-938a-a891dc4d6aee admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.014652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99256f34-cbae-491c-938a-a891dc4d6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.015334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99256f34-cbae-491c-938a-a891dc4d6aee admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.016321 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99256f34-cbae-491c-938a-a891dc4d6aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.019012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99256f34-cbae-491c-938a-a891dc4d6aee admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.036155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b209351-0486-4341-92fa-cf5c70dad95c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.040659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc532fb-2297-489d-a989-e9d78340df0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.041298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc532fb-2297-489d-a989-e9d78340df0a service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.041577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc532fb-2297-489d-a989-e9d78340df0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.041854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc532fb-2297-489d-a989-e9d78340df0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.053953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc532fb-2297-489d-a989-e9d78340df0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.055487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc532fb-2297-489d-a989-e9d78340df0a service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.066380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 796/1577] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:13.066792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 782/1578] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:12 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:13.067783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99256f34-cbae-491c-938a-a891dc4d6aee admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.070818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc532fb-2297-489d-a989-e9d78340df0a service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.081869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc532fb-2297-489d-a989-e9d78340df0a service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.162275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99256f34-cbae-491c-938a-a891dc4d6aee admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.172420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffe71e-c291-4ee4-8a95-04b307403b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.173545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffe71e-c291-4ee4-8a95-04b307403b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.174259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffe71e-c291-4ee4-8a95-04b307403b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.174797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffe71e-c291-4ee4-8a95-04b307403b68 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.176219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffe71e-c291-4ee4-8a95-04b307403b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.177512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20d486-497c-4fe8-b7c2-b8167efeb68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.178697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20d486-497c-4fe8-b7c2-b8167efeb68b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.179242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20d486-497c-4fe8-b7c2-b8167efeb68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.179695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20d486-497c-4fe8-b7c2-b8167efeb68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.179815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffe71e-c291-4ee4-8a95-04b307403b68 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.180963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20d486-497c-4fe8-b7c2-b8167efeb68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.184077 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20d486-497c-4fe8-b7c2-b8167efeb68b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.204316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 797/1579] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.205323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20d486-497c-4fe8-b7c2-b8167efeb68b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.220503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 783/1580] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:13 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:13.222697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffe71e-c291-4ee4-8a95-04b307403b68 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.228938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20d486-497c-4fe8-b7c2-b8167efeb68b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.239062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1befe-21f8-4aa4-b7e6-3f35b554cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.240100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1befe-21f8-4aa4-b7e6-3f35b554cce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.240762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1befe-21f8-4aa4-b7e6-3f35b554cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.241813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1befe-21f8-4aa4-b7e6-3f35b554cce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.241969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffe71e-c291-4ee4-8a95-04b307403b68 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.242494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1befe-21f8-4aa4-b7e6-3f35b554cce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.246582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1befe-21f8-4aa4-b7e6-3f35b554cce8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.251093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8d6a9-556d-4517-8e8d-1a9b60df29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.252088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d6a9-556d-4517-8e8d-1a9b60df29c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.252573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d6a9-556d-4517-8e8d-1a9b60df29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.253177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8d6a9-556d-4517-8e8d-1a9b60df29c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.254282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8d6a9-556d-4517-8e8d-1a9b60df29c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.257208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8d6a9-556d-4517-8e8d-1a9b60df29c8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.279829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 784/1581] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.279829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8d6a9-556d-4517-8e8d-1a9b60df29c8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.293546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8d6a9-556d-4517-8e8d-1a9b60df29c8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.300141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea452a-29e3-43f9-8b9b-de215a7c4b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.301111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 798/1582] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:13 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:13.301306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea452a-29e3-43f9-8b9b-de215a7c4b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.302166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea452a-29e3-43f9-8b9b-de215a7c4b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.302469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1befe-21f8-4aa4-b7e6-3f35b554cce8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.302852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea452a-29e3-43f9-8b9b-de215a7c4b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.303649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea452a-29e3-43f9-8b9b-de215a7c4b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.305440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea452a-29e3-43f9-8b9b-de215a7c4b45 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.316292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:13.324264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 785/1583] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.324264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea452a-29e3-43f9-8b9b-de215a7c4b45 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.335711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea452a-29e3-43f9-8b9b-de215a7c4b45 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.414972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1befe-21f8-4aa4-b7e6-3f35b554cce8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.416618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb555e-2f9f-449b-b564-938ca1478bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.418170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb555e-2f9f-449b-b564-938ca1478bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.418170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb555e-2f9f-449b-b564-938ca1478bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.418170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb555e-2f9f-449b-b564-938ca1478bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.418898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb555e-2f9f-449b-b564-938ca1478bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.421055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb555e-2f9f-449b-b564-938ca1478bb0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.422075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c973b25-8011-4c23-8bd0-fb678bc8c4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.422798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c973b25-8011-4c23-8bd0-fb678bc8c4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.423225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c973b25-8011-4c23-8bd0-fb678bc8c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.423588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c973b25-8011-4c23-8bd0-fb678bc8c4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.424653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c973b25-8011-4c23-8bd0-fb678bc8c4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.426888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c973b25-8011-4c23-8bd0-fb678bc8c4a7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.459382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 786/1584] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:13 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:13.459382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb555e-2f9f-449b-b564-938ca1478bb0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.469730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 799/1585] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:13 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:13.470772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c973b25-8011-4c23-8bd0-fb678bc8c4a7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.481000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb555e-2f9f-449b-b564-938ca1478bb0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.497759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:13.602479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c973b25-8011-4c23-8bd0-fb678bc8c4a7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.608069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ebb08-e8fe-4516-85bb-4ad33685e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.608739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ebb08-e8fe-4516-85bb-4ad33685e65a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.609052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ebb08-e8fe-4516-85bb-4ad33685e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.609372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ebb08-e8fe-4516-85bb-4ad33685e65a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.609940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ebb08-e8fe-4516-85bb-4ad33685e65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.611630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ebb08-e8fe-4516-85bb-4ad33685e65a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.618376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d47ca-bcd3-4584-bfee-e47b34d71066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.620819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d47ca-bcd3-4584-bfee-e47b34d71066 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.621709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d47ca-bcd3-4584-bfee-e47b34d71066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.622324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d47ca-bcd3-4584-bfee-e47b34d71066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.625003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d47ca-bcd3-4584-bfee-e47b34d71066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.625230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 800/1586] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.625550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ebb08-e8fe-4516-85bb-4ad33685e65a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.627020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d47ca-bcd3-4584-bfee-e47b34d71066 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.638447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ebb08-e8fe-4516-85bb-4ad33685e65a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.644818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785ea3-603e-48d9-b168-147c85b06312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.646731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785ea3-603e-48d9-b168-147c85b06312 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.646968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785ea3-603e-48d9-b168-147c85b06312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.647579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d785ea3-603e-48d9-b168-147c85b06312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.648354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d785ea3-603e-48d9-b168-147c85b06312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.650580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d785ea3-603e-48d9-b168-147c85b06312 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.652694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 787/1587] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.654093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d47ca-bcd3-4584-bfee-e47b34d71066 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.673045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d47ca-bcd3-4584-bfee-e47b34d71066 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.677776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 801/1588] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.679123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785ea3-603e-48d9-b168-147c85b06312 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.682035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cee4c9-c3b9-4790-83ca-702270f61fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.683509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cee4c9-c3b9-4790-83ca-702270f61fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.684121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cee4c9-c3b9-4790-83ca-702270f61fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.684677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cee4c9-c3b9-4790-83ca-702270f61fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.687253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cee4c9-c3b9-4790-83ca-702270f61fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.691239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d785ea3-603e-48d9-b168-147c85b06312 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.691978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cee4c9-c3b9-4790-83ca-702270f61fc8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.698891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3a1d9-8b23-4ff0-b342-bc97c3d67b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.699639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3a1d9-8b23-4ff0-b342-bc97c3d67b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.699976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3a1d9-8b23-4ff0-b342-bc97c3d67b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.700480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3a1d9-8b23-4ff0-b342-bc97c3d67b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.701299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3a1d9-8b23-4ff0-b342-bc97c3d67b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.703254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3a1d9-8b23-4ff0-b342-bc97c3d67b5b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.721487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 802/1589] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.722430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3a1d9-8b23-4ff0-b342-bc97c3d67b5b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.739114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3a1d9-8b23-4ff0-b342-bc97c3d67b5b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.742004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 788/1590] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:13 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:13.744279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cee4c9-c3b9-4790-83ca-702270f61fc8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.749860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c212a7-4da0-4f35-8810-e10954d6dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.750605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c212a7-4da0-4f35-8810-e10954d6dda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.750953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c212a7-4da0-4f35-8810-e10954d6dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.751346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c212a7-4da0-4f35-8810-e10954d6dda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.752089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c212a7-4da0-4f35-8810-e10954d6dda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.754080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c212a7-4da0-4f35-8810-e10954d6dda8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.767929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cee4c9-c3b9-4790-83ca-702270f61fc8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.779700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 803/1591] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.779700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c212a7-4da0-4f35-8810-e10954d6dda8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.781831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48644d32-5ca4-4b90-a068-eeb042e642df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.783137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48644d32-5ca4-4b90-a068-eeb042e642df admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.783736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48644d32-5ca4-4b90-a068-eeb042e642df admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.784306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48644d32-5ca4-4b90-a068-eeb042e642df admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.785813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48644d32-5ca4-4b90-a068-eeb042e642df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.792215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48644d32-5ca4-4b90-a068-eeb042e642df admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.792829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c212a7-4da0-4f35-8810-e10954d6dda8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.798438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00ce3-7570-4395-9c11-44c992cf54d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.799228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00ce3-7570-4395-9c11-44c992cf54d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.799626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00ce3-7570-4395-9c11-44c992cf54d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.799974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00ce3-7570-4395-9c11-44c992cf54d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.800791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc00ce3-7570-4395-9c11-44c992cf54d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.803618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc00ce3-7570-4395-9c11-44c992cf54d2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.826666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 804/1592] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:13.826666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00ce3-7570-4395-9c11-44c992cf54d2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.843839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00ce3-7570-4395-9c11-44c992cf54d2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.848164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 789/1593] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:13 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:13.854604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48644d32-5ca4-4b90-a068-eeb042e642df admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.855610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b6944-4a14-4f6c-ae06-c96bab00f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.857272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b6944-4a14-4f6c-ae06-c96bab00f781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.858367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b6944-4a14-4f6c-ae06-c96bab00f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.859123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b6944-4a14-4f6c-ae06-c96bab00f781 admin admin] PATH_INFO: `/v3/projects/78b6e21e85e84d4e8c5b0cf3f18ba794/users/46bc54cee94d424cbb1e041f8831e7ee/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.873955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48644d32-5ca4-4b90-a068-eeb042e642df admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:13.882879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c3236-ab4f-44f9-83a2-bd8c124fb0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:13.884090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c3236-ab4f-44f9-83a2-bd8c124fb0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:13.884532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c3236-ab4f-44f9-83a2-bd8c124fb0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:13.884923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c3236-ab4f-44f9-83a2-bd8c124fb0c3 admin admin] PATH_INFO: `/v3/projects/409fba5f7d3140fea63b7d03a2884540/users/ca505faad29a4155a9c4f562b2b47dee/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:13.897287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b6944-4a14-4f6c-ae06-c96bab00f781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b6e21e85e84d4e8c5b0cf3f18ba794, user_id=46bc54cee94d424cbb1e041f8831e7ee, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.901609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b6944-4a14-4f6c-ae06-c96bab00f781 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.911674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c3236-ab4f-44f9-83a2-bd8c124fb0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=409fba5f7d3140fea63b7d03a2884540, user_id=ca505faad29a4155a9c4f562b2b47dee, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:13.917247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c3236-ab4f-44f9-83a2-bd8c124fb0c3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:13.939331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 805/1594] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:13 2022] PUT /identity/v3/projects/78b6e21e85e84d4e8c5b0cf3f18ba794/users/46bc54cee94d424cbb1e041f8831e7ee/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:13.939331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b6944-4a14-4f6c-ae06-c96bab00f781 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.943890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 790/1595] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:13 2022] PUT /identity/v3/projects/409fba5f7d3140fea63b7d03a2884540/users/ca505faad29a4155a9c4f562b2b47dee/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:13.945966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c3236-ab4f-44f9-83a2-bd8c124fb0c3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:13.975742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:14.043847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b6944-4a14-4f6c-ae06-c96bab00f781 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.067304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c3236-ab4f-44f9-83a2-bd8c124fb0c3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.072534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305c792-12ea-48b5-9ad4-ae2345ca9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.073101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305c792-12ea-48b5-9ad4-ae2345ca9cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.073278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305c792-12ea-48b5-9ad4-ae2345ca9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.073666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305c792-12ea-48b5-9ad4-ae2345ca9cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.074455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305c792-12ea-48b5-9ad4-ae2345ca9cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.076138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305c792-12ea-48b5-9ad4-ae2345ca9cdf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.089364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 791/1596] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:14.090940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305c792-12ea-48b5-9ad4-ae2345ca9cdf admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:14.111043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305c792-12ea-48b5-9ad4-ae2345ca9cdf admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.117586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8458a-4e92-4226-bb05-38bdd3d0b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.118237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8458a-4e92-4226-bb05-38bdd3d0b413 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.118521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8458a-4e92-4226-bb05-38bdd3d0b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.118798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8458a-4e92-4226-bb05-38bdd3d0b413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.119502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8458a-4e92-4226-bb05-38bdd3d0b413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.121233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8458a-4e92-4226-bb05-38bdd3d0b413 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.133073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9077b-2fa6-496c-8cae-90cceef620e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.134000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 792/1597] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:14.134783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9077b-2fa6-496c-8cae-90cceef620e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.134961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8458a-4e92-4226-bb05-38bdd3d0b413 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:14.135463 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9077b-2fa6-496c-8cae-90cceef620e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.135986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9077b-2fa6-496c-8cae-90cceef620e9 admin admin] PATH_INFO: `/v3/projects/8e360fc2c5084778bc9fcbce91b4e52f/users/e50e7b34b8d84a86ac58d892ff5fbdb2/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.153008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8458a-4e92-4226-bb05-38bdd3d0b413 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.158790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12771-0242-46a6-aa25-abdcb203bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.159499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12771-0242-46a6-aa25-abdcb203bb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.159941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12771-0242-46a6-aa25-abdcb203bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.160225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12771-0242-46a6-aa25-abdcb203bb9a admin admin] PATH_INFO: `/v3/projects/7aa04ed8c3fb4f2983d711d9238300d8/users/1038f45fbf934948b3586d73389ddd33/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.161304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9077b-2fa6-496c-8cae-90cceef620e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e360fc2c5084778bc9fcbce91b4e52f, user_id=e50e7b34b8d84a86ac58d892ff5fbdb2, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.168294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9077b-2fa6-496c-8cae-90cceef620e9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.191598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12771-0242-46a6-aa25-abdcb203bb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa04ed8c3fb4f2983d711d9238300d8, user_id=1038f45fbf934948b3586d73389ddd33, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.196959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12771-0242-46a6-aa25-abdcb203bb9a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.197189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 806/1598] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:13 2022] PUT /identity/v3/projects/8e360fc2c5084778bc9fcbce91b4e52f/users/e50e7b34b8d84a86ac58d892ff5fbdb2/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:14.198451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9077b-2fa6-496c-8cae-90cceef620e9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:14.259669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 793/1599] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:14 2022] PUT /identity/v3/projects/7aa04ed8c3fb4f2983d711d9238300d8/users/1038f45fbf934948b3586d73389ddd33/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:14.259669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bebf8b-c432-44bc-a75b-f7315b9022ec None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.259669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bebf8b-c432-44bc-a75b-f7315b9022ec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.259669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bebf8b-c432-44bc-a75b-f7315b9022ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.279961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:14.295489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-77bebf8b-c432-44bc-a75b-f7315b9022ec None None] MFA Rules not processed for user `46bc54cee94d424cbb1e041f8831e7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:14.297980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-77bebf8b-c432-44bc-a75b-f7315b9022ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:14.339369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9077b-2fa6-496c-8cae-90cceef620e9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.436348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 794/1600] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:14.439479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c8342-a6a4-4e2e-8cf7-55e429127fdf None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.439954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c8342-a6a4-4e2e-8cf7-55e429127fdf None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.440616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c8342-a6a4-4e2e-8cf7-55e429127fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.475714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e27a-78bb-4991-9f7e-6c8e65423c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.477033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e27a-78bb-4991-9f7e-6c8e65423c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.477418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e27a-78bb-4991-9f7e-6c8e65423c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.477756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e27a-78bb-4991-9f7e-6c8e65423c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.478587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01e27a-78bb-4991-9f7e-6c8e65423c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.479617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b42c8342-a6a4-4e2e-8cf7-55e429127fdf None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:14.481309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01e27a-78bb-4991-9f7e-6c8e65423c0f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.481503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b42c8342-a6a4-4e2e-8cf7-55e429127fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:14.483876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:14.516656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 795/1601] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:14.516656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c8342-a6a4-4e2e-8cf7-55e429127fdf None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:14.521426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 807/1602] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:14.525107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e27a-78bb-4991-9f7e-6c8e65423c0f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:14.540521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e27a-78bb-4991-9f7e-6c8e65423c0f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.540871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c8342-a6a4-4e2e-8cf7-55e429127fdf None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.551604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9b11-0ebb-458a-ac3a-479cb14f3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.552539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9b11-0ebb-458a-ac3a-479cb14f3fac admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.552830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9b11-0ebb-458a-ac3a-479cb14f3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.553158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9b11-0ebb-458a-ac3a-479cb14f3fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.554195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9b11-0ebb-458a-ac3a-479cb14f3fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.556449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e148879-4842-4174-9bd4-16fe6553f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.557841 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148879-4842-4174-9bd4-16fe6553f691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.558047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9b11-0ebb-458a-ac3a-479cb14f3fac admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.558211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148879-4842-4174-9bd4-16fe6553f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.558372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148879-4842-4174-9bd4-16fe6553f691 admin admin] PATH_INFO: `/v3/projects/7646bad963114554a255a03c0a16884a/users/2c871cad6d394173b2b43fc89940f1ac/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.574131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 796/1603] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:14.575335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de964ad-e9ec-486e-89ef-44f81aee69e5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.577493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de964ad-e9ec-486e-89ef-44f81aee69e5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.577890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de964ad-e9ec-486e-89ef-44f81aee69e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.592677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e148879-4842-4174-9bd4-16fe6553f691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7646bad963114554a255a03c0a16884a, user_id=2c871cad6d394173b2b43fc89940f1ac, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.599674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e148879-4842-4174-9bd4-16fe6553f691 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.625880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9de964ad-e9ec-486e-89ef-44f81aee69e5 None None] MFA Rules not processed for user `e50e7b34b8d84a86ac58d892ff5fbdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:14.629172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9de964ad-e9ec-486e-89ef-44f81aee69e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:14.630514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 808/1604] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:14 2022] PUT /identity/v3/projects/7646bad963114554a255a03c0a16884a/users/2c871cad6d394173b2b43fc89940f1ac/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:14.635881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e94c-910f-4ec8-9f63-f153b7241f49 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.636189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e94c-910f-4ec8-9f63-f153b7241f49 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.636471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e94c-910f-4ec8-9f63-f153b7241f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.670423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8f09e94c-910f-4ec8-9f63-f153b7241f49 None None] MFA Rules not processed for user `1038f45fbf934948b3586d73389ddd33`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:14.671704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8f09e94c-910f-4ec8-9f63-f153b7241f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:14.749302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 797/1605] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:14.749302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de964ad-e9ec-486e-89ef-44f81aee69e5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:14.783768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 809/1606] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:14.785121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09e94c-910f-4ec8-9f63-f153b7241f49 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:14.850605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de964ad-e9ec-486e-89ef-44f81aee69e5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.857027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138eb9f-8c9c-4d67-b6e7-bcfc7b4030ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.859258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138eb9f-8c9c-4d67-b6e7-bcfc7b4030ea service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.860004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138eb9f-8c9c-4d67-b6e7-bcfc7b4030ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.861878 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138eb9f-8c9c-4d67-b6e7-bcfc7b4030ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.873340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09e94c-910f-4ec8-9f63-f153b7241f49 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.878462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138eb9f-8c9c-4d67-b6e7-bcfc7b4030ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.880790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138eb9f-8c9c-4d67-b6e7-bcfc7b4030ea service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.882648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3622-a64b-40e3-87f9-13dd831043d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.883857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3622-a64b-40e3-87f9-13dd831043d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.884507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3622-a64b-40e3-87f9-13dd831043d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.888220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3622-a64b-40e3-87f9-13dd831043d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.890156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3622-a64b-40e3-87f9-13dd831043d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:14.893528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3622-a64b-40e3-87f9-13dd831043d9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:14.898485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 798/1607] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:14.900292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1f61-66c8-4877-8e6a-b1df4d18edef None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.901421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1f61-66c8-4877-8e6a-b1df4d18edef None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.901910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1f61-66c8-4877-8e6a-b1df4d18edef None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.906210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 799/1608] 10.222.0.55 () {54 vars in 962 bytes} [Tue Sep 13 12:32:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:32:14.907641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d1f61-66c8-4877-8e6a-b1df4d18edef None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:14.919296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 810/1609] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:14.921046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d323a-5fef-43ed-b27a-e4dc057e5a5d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.922157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d323a-5fef-43ed-b27a-e4dc057e5a5d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.922441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d323a-5fef-43ed-b27a-e4dc057e5a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.951733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d1f61-66c8-4877-8e6a-b1df4d18edef None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:14.967633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f156-a93c-4c3d-aa1e-9889d9f31ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:14.968751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f156-a93c-4c3d-aa1e-9889d9f31ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:14.969214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f156-a93c-4c3d-aa1e-9889d9f31ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:14.969667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f156-a93c-4c3d-aa1e-9889d9f31ea8 admin admin] PATH_INFO: `/v3/projects/19e8216d030f41f2954c0b118a123eec/users/e6abe049ae6a4b5db081fcc0e164075b/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:14.978270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-002d323a-5fef-43ed-b27a-e4dc057e5a5d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:14.980620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-002d323a-5fef-43ed-b27a-e4dc057e5a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:14.996789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:15.018017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 811/1610] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:15.018989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979f156-a93c-4c3d-aa1e-9889d9f31ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e8216d030f41f2954c0b118a123eec, user_id=e6abe049ae6a4b5db081fcc0e164075b, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:15.019819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d323a-5fef-43ed-b27a-e4dc057e5a5d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:15.026840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979f156-a93c-4c3d-aa1e-9889d9f31ea8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:15.064079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 800/1611] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:14 2022] PUT /identity/v3/projects/19e8216d030f41f2954c0b118a123eec/users/e6abe049ae6a4b5db081fcc0e164075b/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:15.065423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f156-a93c-4c3d-aa1e-9889d9f31ea8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:15.175734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d323a-5fef-43ed-b27a-e4dc057e5a5d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:15.182096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:15.263739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f156-a93c-4c3d-aa1e-9889d9f31ea8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:15.287379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adb992-0a98-4e11-b6ec-4eb0c7eb60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:15.287379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb992-0a98-4e11-b6ec-4eb0c7eb60cf admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:15.287379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb992-0a98-4e11-b6ec-4eb0c7eb60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:15.287859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb992-0a98-4e11-b6ec-4eb0c7eb60cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:15.288815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adb992-0a98-4e11-b6ec-4eb0c7eb60cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:15.301592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adb992-0a98-4e11-b6ec-4eb0c7eb60cf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:15.318367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9971a2c-bf71-4ef8-9f29-582617f7a7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:15.319929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971a2c-bf71-4ef8-9f29-582617f7a7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:15.320609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971a2c-bf71-4ef8-9f29-582617f7a7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:15.321052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971a2c-bf71-4ef8-9f29-582617f7a7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:15.384282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 801/1612] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:15 2022] POST /identity/v3/projects => generated 383 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:15.387053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdd02-2253-4cd7-9b48-69c1d96b5af5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:15.388860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdd02-2253-4cd7-9b48-69c1d96b5af5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:15.389361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdd02-2253-4cd7-9b48-69c1d96b5af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:15.477469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9971a2c-bf71-4ef8-9f29-582617f7a7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:15.483243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9971a2c-bf71-4ef8-9f29-582617f7a7d7 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:15.493941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d56bdd02-2253-4cd7-9b48-69c1d96b5af5 None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:15.496091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d56bdd02-2253-4cd7-9b48-69c1d96b5af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:15.503288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 812/1613] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:15.504239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9971a2c-bf71-4ef8-9f29-582617f7a7d7 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:15.527063 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9971a2c-bf71-4ef8-9f29-582617f7a7d7 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:15.663053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 802/1614] 10.222.0.55 () {58 vars in 1059 bytes} [Tue Sep 13 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:15.675715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bdd02-2253-4cd7-9b48-69c1d96b5af5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:15.739742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164451d-c153-4dd9-9cff-7a60adc884f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:15.742583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164451d-c153-4dd9-9cff-7a60adc884f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:15.744180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164451d-c153-4dd9-9cff-7a60adc884f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:15.747305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164451d-c153-4dd9-9cff-7a60adc884f9 admin admin] PATH_INFO: `/v3/projects/b48d953efa39463cbda0858d2c1f1404/users/21209f86167545f19f3c739892240495/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:15.801187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bdd02-2253-4cd7-9b48-69c1d96b5af5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:15.805551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164451d-c153-4dd9-9cff-7a60adc884f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48d953efa39463cbda0858d2c1f1404, user_id=21209f86167545f19f3c739892240495, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:15.811756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164451d-c153-4dd9-9cff-7a60adc884f9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:15.814476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d034547-7489-4893-b14b-3c82c2af4036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:15.815506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d034547-7489-4893-b14b-3c82c2af4036 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:15.816010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d034547-7489-4893-b14b-3c82c2af4036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:15.816415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d034547-7489-4893-b14b-3c82c2af4036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:15.835004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:15.849947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d034547-7489-4893-b14b-3c82c2af4036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:15.852375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d034547-7489-4893-b14b-3c82c2af4036 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:15.859708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 813/1615] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:15 2022] PUT /identity/v3/projects/b48d953efa39463cbda0858d2c1f1404/users/21209f86167545f19f3c739892240495/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:15.867496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259a55-a4b6-407f-b350-1d9651025abe None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:15.868293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259a55-a4b6-407f-b350-1d9651025abe None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:15.868964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259a55-a4b6-407f-b350-1d9651025abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:15.872998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 803/1616] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:15.874172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d034547-7489-4893-b14b-3c82c2af4036 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:15.895792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d034547-7489-4893-b14b-3c82c2af4036 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:15.926444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-54259a55-a4b6-407f-b350-1d9651025abe None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:15.930740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-54259a55-a4b6-407f-b350-1d9651025abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:16.011697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03925c2c-b36d-4e7c-926a-ba8263cd770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:16.017489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03925c2c-b36d-4e7c-926a-ba8263cd770b admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:16.017838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03925c2c-b36d-4e7c-926a-ba8263cd770b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:16.018146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03925c2c-b36d-4e7c-926a-ba8263cd770b admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:16.018833 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03925c2c-b36d-4e7c-926a-ba8263cd770b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:16.021776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03925c2c-b36d-4e7c-926a-ba8263cd770b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:16.146726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 804/1617] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:15 2022] POST /identity/v3/users => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:16.146726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03925c2c-b36d-4e7c-926a-ba8263cd770b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:16.193881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:16.286963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 814/1618] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:16.296323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fffe5-8033-4e2a-bfd5-932830705407 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:16.296575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fffe5-8033-4e2a-bfd5-932830705407 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:16.296908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fffe5-8033-4e2a-bfd5-932830705407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:16.396521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03925c2c-b36d-4e7c-926a-ba8263cd770b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:16.404458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-034fffe5-8033-4e2a-bfd5-932830705407 None None] MFA Rules not processed for user `21209f86167545f19f3c739892240495`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:16.408893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c1b5d-3968-4691-9c21-d237814bc017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:16.410104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-034fffe5-8033-4e2a-bfd5-932830705407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:16.411073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c1b5d-3968-4691-9c21-d237814bc017 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:16.412028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c1b5d-3968-4691-9c21-d237814bc017 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:16.412812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c1b5d-3968-4691-9c21-d237814bc017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:16.524713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c1b5d-3968-4691-9c21-d237814bc017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:16.526404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c1b5d-3968-4691-9c21-d237814bc017 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:16.583672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 805/1619] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:16.584723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c1b5d-3968-4691-9c21-d237814bc017 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:16.602639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 815/1620] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:16.615005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c1b5d-3968-4691-9c21-d237814bc017 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:16.617489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fffe5-8033-4e2a-bfd5-932830705407 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:16.631398 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0fe6-056b-432a-9fb7-4e267bcc2335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:16.632356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0fe6-056b-432a-9fb7-4e267bcc2335 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:16.632826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0fe6-056b-432a-9fb7-4e267bcc2335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:16.633261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0fe6-056b-432a-9fb7-4e267bcc2335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:16.634364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0fe6-056b-432a-9fb7-4e267bcc2335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:16.640126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0fe6-056b-432a-9fb7-4e267bcc2335 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:16.684448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 806/1621] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:16.688250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0fe6-056b-432a-9fb7-4e267bcc2335 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:16.737789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0fe6-056b-432a-9fb7-4e267bcc2335 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:16.760038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3ed62-17b5-4bca-8b20-cbb07690074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:16.768095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3ed62-17b5-4bca-8b20-cbb07690074b admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:16.769762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3ed62-17b5-4bca-8b20-cbb07690074b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:16.770852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3ed62-17b5-4bca-8b20-cbb07690074b admin admin] PATH_INFO: `/v3/projects/bf0d469618064c61940540ee5912cbbe/users/c56b6fa455894f7ab405ef6657188537/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:16.798694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:16.821665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fffe5-8033-4e2a-bfd5-932830705407 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:16.826422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8431e-f1d4-4732-85b3-196f0eb57608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:16.830057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8431e-f1d4-4732-85b3-196f0eb57608 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:16.830057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8431e-f1d4-4732-85b3-196f0eb57608 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:16.830057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8431e-f1d4-4732-85b3-196f0eb57608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:16.830598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3ed62-17b5-4bca-8b20-cbb07690074b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0d469618064c61940540ee5912cbbe, user_id=c56b6fa455894f7ab405ef6657188537, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:16.862480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3ed62-17b5-4bca-8b20-cbb07690074b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:16.865015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8431e-f1d4-4732-85b3-196f0eb57608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:16.867706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8431e-f1d4-4732-85b3-196f0eb57608 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:16.905907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 816/1622] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:16.913278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c03db-1636-4ce9-9d1f-71c9e0f251d4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:16.913564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c03db-1636-4ce9-9d1f-71c9e0f251d4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:16.914982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c03db-1636-4ce9-9d1f-71c9e0f251d4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:16.938298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 817/1623] 10.222.0.55 () {54 vars in 962 bytes} [Tue Sep 13 12:32:16 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:32:16.949748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41a1a-5adf-4472-817b-ffec1aa6ab6e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:16.950283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41a1a-5adf-4472-817b-ffec1aa6ab6e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:16.951626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41a1a-5adf-4472-817b-ffec1aa6ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:16.955652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 807/1624] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:16 2022] PUT /identity/v3/projects/bf0d469618064c61940540ee5912cbbe/users/c56b6fa455894f7ab405ef6657188537/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:16.957784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3ed62-17b5-4bca-8b20-cbb07690074b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:17.058113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-49f41a1a-5adf-4472-817b-ffec1aa6ab6e None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:17.065865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-49f41a1a-5adf-4472-817b-ffec1aa6ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:17.152568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3ed62-17b5-4bca-8b20-cbb07690074b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:17.166764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caa716-b25e-41be-b8bb-e42d1806bb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:17.167125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa716-b25e-41be-b8bb-e42d1806bb9b admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:17.169444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa716-b25e-41be-b8bb-e42d1806bb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:17.170599 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa716-b25e-41be-b8bb-e42d1806bb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:17.173496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caa716-b25e-41be-b8bb-e42d1806bb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:17.184138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caa716-b25e-41be-b8bb-e42d1806bb9b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:17.220374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 808/1625] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:17.224221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caa716-b25e-41be-b8bb-e42d1806bb9b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:17.258525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caa716-b25e-41be-b8bb-e42d1806bb9b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:17.312452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c493b-c7c1-42d7-972a-5c7499fe05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:17.313808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c493b-c7c1-42d7-972a-5c7499fe05c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:17.316184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c493b-c7c1-42d7-972a-5c7499fe05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:17.316840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c493b-c7c1-42d7-972a-5c7499fe05c5 admin admin] PATH_INFO: `/v3/projects/bf0d469618064c61940540ee5912cbbe/users/c56b6fa455894f7ab405ef6657188537/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:17.323290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c493b-c7c1-42d7-972a-5c7499fe05c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0d469618064c61940540ee5912cbbe, user_id=c56b6fa455894f7ab405ef6657188537, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:17.329053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c493b-c7c1-42d7-972a-5c7499fe05c5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:17.369400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 809/1626] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:17 2022] PUT /identity/v3/projects/bf0d469618064c61940540ee5912cbbe/users/c56b6fa455894f7ab405ef6657188537/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:17.375109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9c507-8811-483a-b96c-66ecfa5a24b6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:17.375591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9c507-8811-483a-b96c-66ecfa5a24b6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:17.376136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9c507-8811-483a-b96c-66ecfa5a24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:17.402233 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 818/1627] 10.222.0.55 () {58 vars in 1059 bytes} [Tue Sep 13 12:32:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:17.404068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41a1a-5adf-4472-817b-ffec1aa6ab6e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:17.433510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41a1a-5adf-4472-817b-ffec1aa6ab6e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:17.434397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2bf9c507-8811-483a-b96c-66ecfa5a24b6 None None] MFA Rules not processed for user `c56b6fa455894f7ab405ef6657188537`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:17.436972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2bf9c507-8811-483a-b96c-66ecfa5a24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:17.449794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:17.619596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 810/1628] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:17.659489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9c507-8811-483a-b96c-66ecfa5a24b6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:17.693578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e218e80-4696-4fe9-a787-89b648a0d92b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:17.693871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e218e80-4696-4fe9-a787-89b648a0d92b service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:17.695221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e218e80-4696-4fe9-a787-89b648a0d92b service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:17.695745 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e218e80-4696-4fe9-a787-89b648a0d92b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:17.819886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e218e80-4696-4fe9-a787-89b648a0d92b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:17.822233 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e218e80-4696-4fe9-a787-89b648a0d92b service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:17.839623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 819/1629] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:17.842384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d27708-8cd5-44ea-a3c7-dbf2ecd1c046 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:17.843241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d27708-8cd5-44ea-a3c7-dbf2ecd1c046 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:17.843628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d27708-8cd5-44ea-a3c7-dbf2ecd1c046 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:17.845795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 820/1630] 10.222.0.55 () {54 vars in 912 bytes} [Tue Sep 13 12:32:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:32:17.870336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9c507-8811-483a-b96c-66ecfa5a24b6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:17.880440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f5f66-811b-496f-a15b-4c0765448d61 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:17.880440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f5f66-811b-496f-a15b-4c0765448d61 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:17.880440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f5f66-811b-496f-a15b-4c0765448d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:17.881615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988899b-12ff-476c-b533-858707ca46b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:17.882478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988899b-12ff-476c-b533-858707ca46b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:17.882938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988899b-12ff-476c-b533-858707ca46b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:17.883441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988899b-12ff-476c-b533-858707ca46b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:17.908662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988899b-12ff-476c-b533-858707ca46b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:17.912890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988899b-12ff-476c-b533-858707ca46b7 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:17.927671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:17.945401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 811/1631] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:17.995405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d62f5f66-811b-496f-a15b-4c0765448d61 None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:18.003805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d62f5f66-811b-496f-a15b-4c0765448d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:18.057448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 821/1632] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:32:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:18.084121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988899b-12ff-476c-b533-858707ca46b7 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:18.111129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988899b-12ff-476c-b533-858707ca46b7 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:18.135085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e138d08-1307-4f67-9d80-d125cf089b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:18.138021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e138d08-1307-4f67-9d80-d125cf089b9d service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:18.138432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e138d08-1307-4f67-9d80-d125cf089b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:18.138916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e138d08-1307-4f67-9d80-d125cf089b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:18.229832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e138d08-1307-4f67-9d80-d125cf089b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:18.239860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e138d08-1307-4f67-9d80-d125cf089b9d service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:18.310554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 812/1633] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:32:18.463650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f5f66-811b-496f-a15b-4c0765448d61 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:18.524457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f5f66-811b-496f-a15b-4c0765448d61 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:18.555094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2e35d-0b38-4f8a-86f3-8820ffcd87a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:18.556454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e35d-0b38-4f8a-86f3-8820ffcd87a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:18.557712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e35d-0b38-4f8a-86f3-8820ffcd87a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:18.560454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e35d-0b38-4f8a-86f3-8820ffcd87a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:18.818535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2e35d-0b38-4f8a-86f3-8820ffcd87a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:18.820575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2e35d-0b38-4f8a-86f3-8820ffcd87a2 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:18.846171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 822/1634] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:18.971635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745b75-cba1-447b-9442-8145fd9f86a5 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:18.972616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745b75-cba1-447b-9442-8145fd9f86a5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:18.972616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745b75-cba1-447b-9442-8145fd9f86a5 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:18.976753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 813/1635] 10.222.0.55 () {54 vars in 912 bytes} [Tue Sep 13 12:32:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:32:19.005065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cd407-4434-467f-8b58-f86b7784457b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:19.005694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cd407-4434-467f-8b58-f86b7784457b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:19.006109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cd407-4434-467f-8b58-f86b7784457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:19.058681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e51cd407-4434-467f-8b58-f86b7784457b None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:19.060593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e51cd407-4434-467f-8b58-f86b7784457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:19.084156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 823/1636] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:19.099949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8745b75-cba1-447b-9442-8145fd9f86a5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:19.179910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cd407-4434-467f-8b58-f86b7784457b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:19.194710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cd407-4434-467f-8b58-f86b7784457b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:19.208867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a5d8-1b2a-463a-ae54-79a52770b76a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:19.209639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a5d8-1b2a-463a-ae54-79a52770b76a service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:19.210048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a5d8-1b2a-463a-ae54-79a52770b76a service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:19.210431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a5d8-1b2a-463a-ae54-79a52770b76a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:19.249506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40a5d8-1b2a-463a-ae54-79a52770b76a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:19.251229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40a5d8-1b2a-463a-ae54-79a52770b76a service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:19.294040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 824/1637] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:32:19.306346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8745b75-cba1-447b-9442-8145fd9f86a5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:19.319759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:19.320728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:19.321287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:19.321676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] PATH_INFO: `/v3/users/46bc54cee94d424cbb1e041f8831e7ee` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:19.325439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bc54cee94d424cbb1e041f8831e7ee)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:19.326863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: WARNING py.warnings [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:32:19.326863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: warnings.warn(msg) Sep 13 12:32:19.326863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: Sep 13 12:32:19.329059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:19.500248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bc54cee94d424cbb1e041f8831e7ee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:19.535269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bc54cee94d424cbb1e041f8831e7ee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:19.537168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bc54cee94d424cbb1e041f8831e7ee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:19.540038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bc54cee94d424cbb1e041f8831e7ee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:19.577411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bc54cee94d424cbb1e041f8831e7ee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:19.644631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 814/1638] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:19 2022] DELETE /identity/v3/users/46bc54cee94d424cbb1e041f8831e7ee => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:32:19.645953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15af8-5bef-4594-8a0b-7c4faf144414 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:19.646818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15af8-5bef-4594-8a0b-7c4faf144414 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:19.647096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d15af8-5bef-4594-8a0b-7c4faf144414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:19.701852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-37d15af8-5bef-4594-8a0b-7c4faf144414 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:19.707359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-37d15af8-5bef-4594-8a0b-7c4faf144414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:19.762526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:20.004825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 825/1639] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:20.031592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:20.037336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:20.242161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987838a9-ad10-404a-a9cb-b0db7343f84c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:20.247389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250ce6f-f741-4428-ac3c-cb4e901e1beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:20.248643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250ce6f-f741-4428-ac3c-cb4e901e1beb service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:20.249198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250ce6f-f741-4428-ac3c-cb4e901e1beb service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:20.253137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250ce6f-f741-4428-ac3c-cb4e901e1beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:20.292058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250ce6f-f741-4428-ac3c-cb4e901e1beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:20.295226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250ce6f-f741-4428-ac3c-cb4e901e1beb service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:20.375999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 815/1640] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:20.912781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d15af8-5bef-4594-8a0b-7c4faf144414 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:20.920089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-37d15af8-5bef-4594-8a0b-7c4faf144414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:20.986041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d15af8-5bef-4594-8a0b-7c4faf144414 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:21.005562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:21.007544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:21.008568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:21.009364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] PATH_INFO: `/v3/users/1038f45fbf934948b3586d73389ddd33` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:21.012530 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1038f45fbf934948b3586d73389ddd33)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:21.021681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:21.244886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1038f45fbf934948b3586d73389ddd33'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:21.313891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1038f45fbf934948b3586d73389ddd33'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:21.338050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1038f45fbf934948b3586d73389ddd33'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:21.339474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1038f45fbf934948b3586d73389ddd33'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:21.340845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1038f45fbf934948b3586d73389ddd33'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:21.387801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 826/1641] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:20 2022] DELETE /identity/v3/users/1038f45fbf934948b3586d73389ddd33 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:21.393767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79299417-125b-4a63-a18d-c014110e7624 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:21.394470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79299417-125b-4a63-a18d-c014110e7624 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:21.394949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79299417-125b-4a63-a18d-c014110e7624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:21.425335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:21.436758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-79299417-125b-4a63-a18d-c014110e7624 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:21.439815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-79299417-125b-4a63-a18d-c014110e7624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:21.677135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 816/1642] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:21.710639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:21.713273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:21.959601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48772-bf47-4be7-96ad-4d7fa98d7e1b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:21.978886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b2121-e718-478f-999d-65b4dc77984f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:21.981099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b2121-e718-478f-999d-65b4dc77984f service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:21.981566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b2121-e718-478f-999d-65b4dc77984f service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:21.983259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b2121-e718-478f-999d-65b4dc77984f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:22.032161 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b2121-e718-478f-999d-65b4dc77984f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:22.039613 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b2121-e718-478f-999d-65b4dc77984f service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:22.116450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 827/1643] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:23.580346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79299417-125b-4a63-a18d-c014110e7624 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:23.582900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-79299417-125b-4a63-a18d-c014110e7624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:23.608417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79299417-125b-4a63-a18d-c014110e7624 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:23.617378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:23.618466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:23.618944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:23.619440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] PATH_INFO: `/v3/projects/7aa04ed8c3fb4f2983d711d9238300d8` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:23.622900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa04ed8c3fb4f2983d711d9238300d8)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:23.625569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:23.718342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa04ed8c3fb4f2983d711d9238300d8', 'request_id': 'req-ea9671ee-8f2c-44d6-b785-c076cd33824f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:23.729088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa04ed8c3fb4f2983d711d9238300d8', 'request_id': 'req-ea9671ee-8f2c-44d6-b785-c076cd33824f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:23.743688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa04ed8c3fb4f2983d711d9238300d8', 'request_id': 'req-ea9671ee-8f2c-44d6-b785-c076cd33824f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:23.850178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] The token cache is being invalidate because project 7aa04ed8c3fb4f2983d711d9238300d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:23.850651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:23.854513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:23.865077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 817/1644] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:23 2022] DELETE /identity/v3/projects/7aa04ed8c3fb4f2983d711d9238300d8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:23.869230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b2121-e718-478f-999d-65b4dc77984f service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:23.912295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:23.916549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:23.921076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b2121-e718-478f-999d-65b4dc77984f service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:24.012432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:24.122943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:24.124218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:24.125544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:24.125892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] PATH_INFO: `/v3/users/c56b6fa455894f7ab405ef6657188537` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:24.128070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56b6fa455894f7ab405ef6657188537)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:24.131130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:24.191069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9671ee-8f2c-44d6-b785-c076cd33824f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:24.207497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:24.208232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:24.208707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:24.208922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] PATH_INFO: `/v3/users/21209f86167545f19f3c739892240495` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:24.212445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=21209f86167545f19f3c739892240495)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:24.215979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:24.315601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:24.320636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56b6fa455894f7ab405ef6657188537'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.370641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21209f86167545f19f3c739892240495'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.379643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56b6fa455894f7ab405ef6657188537'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.395480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21209f86167545f19f3c739892240495'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.396967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21209f86167545f19f3c739892240495'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.397937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21209f86167545f19f3c739892240495'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.406255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56b6fa455894f7ab405ef6657188537'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.406707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56b6fa455894f7ab405ef6657188537'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.407642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56b6fa455894f7ab405ef6657188537'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.422766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46b250f1-1585-4929-b5f9-a2d209cae7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21209f86167545f19f3c739892240495'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:24.447057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 828/1645] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:23 2022] DELETE /identity/v3/users/c56b6fa455894f7ab405ef6657188537 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:24.448373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:24.450197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:24.479821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 818/1646] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:23 2022] DELETE /identity/v3/users/21209f86167545f19f3c739892240495 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:32:24.489711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd5a21-ad41-4dfa-8137-7028ccfa9a22 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:24.490057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd5a21-ad41-4dfa-8137-7028ccfa9a22 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:24.490337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd5a21-ad41-4dfa-8137-7028ccfa9a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:24.540436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d2dd5a21-ad41-4dfa-8137-7028ccfa9a22 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:24.545465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d2dd5a21-ad41-4dfa-8137-7028ccfa9a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:24.659896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3772c2-ef3d-4159-86c0-e8f9e9b58f26 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:24.691479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 819/1647] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:24.775029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd5a21-ad41-4dfa-8137-7028ccfa9a22 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:24.776860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d2dd5a21-ad41-4dfa-8137-7028ccfa9a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:24.874062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:24.877351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:24.877868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:24.878150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] PATH_INFO: `/v3/projects/78b6e21e85e84d4e8c5b0cf3f18ba794` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:24.885874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b6e21e85e84d4e8c5b0cf3f18ba794)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:24.893872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: WARNING py.warnings [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:32:24.893872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: warnings.warn(msg) Sep 13 12:32:24.893872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: Sep 13 12:32:24.897421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:24.902975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:24.975552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd5a21-ad41-4dfa-8137-7028ccfa9a22 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:24.988791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613485d-2ebe-49c8-80f5-515610e8ccfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:24.989466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613485d-2ebe-49c8-80f5-515610e8ccfb service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:24.989762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613485d-2ebe-49c8-80f5-515610e8ccfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:24.990036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613485d-2ebe-49c8-80f5-515610e8ccfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:25.024256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613485d-2ebe-49c8-80f5-515610e8ccfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:25.025907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613485d-2ebe-49c8-80f5-515610e8ccfb service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:25.072838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 820/1648] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:32:25.088283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b6e21e85e84d4e8c5b0cf3f18ba794', 'request_id': 'req-e3738781-c095-4703-ad5e-f4932a81d948'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:25.116255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b6e21e85e84d4e8c5b0cf3f18ba794', 'request_id': 'req-e3738781-c095-4703-ad5e-f4932a81d948'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:25.141839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b6e21e85e84d4e8c5b0cf3f18ba794', 'request_id': 'req-e3738781-c095-4703-ad5e-f4932a81d948'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:25.200978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] The token cache is being invalidate because project 78b6e21e85e84d4e8c5b0cf3f18ba794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:25.201432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:25.203231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e3738781-c095-4703-ad5e-f4932a81d948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:25.207432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 829/1649] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:24 2022] DELETE /identity/v3/projects/78b6e21e85e84d4e8c5b0cf3f18ba794 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:25.213837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e295-7b02-4d8d-a96a-344ac28c4bcf None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:25.214301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e295-7b02-4d8d-a96a-344ac28c4bcf None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:25.214722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e295-7b02-4d8d-a96a-344ac28c4bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:25.266072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5d99e295-7b02-4d8d-a96a-344ac28c4bcf None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:25.267470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5d99e295-7b02-4d8d-a96a-344ac28c4bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:25.437440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:25.477621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 821/1650] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:25.481573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ac54-0f5e-4639-902f-55fe514d19f0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:25.487715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ac54-0f5e-4639-902f-55fe514d19f0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:25.488950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ac54-0f5e-4639-902f-55fe514d19f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:25.576874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-39d7ac54-0f5e-4639-902f-55fe514d19f0 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:25.581674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-39d7ac54-0f5e-4639-902f-55fe514d19f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:25.631780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 830/1651] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:25.637055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99e295-7b02-4d8d-a96a-344ac28c4bcf None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:25.648557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99e295-7b02-4d8d-a96a-344ac28c4bcf None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:25.654889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:25.655545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:25.655828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:25.656106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:25.656851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:25.657159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:25.658866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:25.695327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 822/1652] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:32:25.705270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7ac54-0f5e-4639-902f-55fe514d19f0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:25.732263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7ac54-0f5e-4639-902f-55fe514d19f0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:25.774885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c3ebe-69ba-4bbf-8285-bde17ce286b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:25.776018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c3ebe-69ba-4bbf-8285-bde17ce286b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:25.776525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c3ebe-69ba-4bbf-8285-bde17ce286b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:25.779754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c3ebe-69ba-4bbf-8285-bde17ce286b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:25.782416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c3ebe-69ba-4bbf-8285-bde17ce286b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:25.789418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c3ebe-69ba-4bbf-8285-bde17ce286b1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:25.927437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 831/1653] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:25 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:25.935663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:25.964473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c44e8-eb9e-42b8-bf06-993221f31718 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:26.139296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf67cd6-8a34-47ac-a759-baa48be4b4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:26.140374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67cd6-8a34-47ac-a759-baa48be4b4ff admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:26.140794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67cd6-8a34-47ac-a759-baa48be4b4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:26.141170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67cd6-8a34-47ac-a759-baa48be4b4ff admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:26.141931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67cd6-8a34-47ac-a759-baa48be4b4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:26.146777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67cd6-8a34-47ac-a759-baa48be4b4ff admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:26.204222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 823/1654] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:25 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:26.205418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c3ebe-69ba-4bbf-8285-bde17ce286b1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:26.226172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c3ebe-69ba-4bbf-8285-bde17ce286b1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:26.248427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624cb4-092a-42fc-a0cf-1f77d4a3fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:26.254412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624cb4-092a-42fc-a0cf-1f77d4a3fd63 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:26.254938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624cb4-092a-42fc-a0cf-1f77d4a3fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:26.255397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624cb4-092a-42fc-a0cf-1f77d4a3fd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:26.256139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0624cb4-092a-42fc-a0cf-1f77d4a3fd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:26.257911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0624cb4-092a-42fc-a0cf-1f77d4a3fd63 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:26.289964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 832/1655] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:32:26.295820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf67cd6-8a34-47ac-a759-baa48be4b4ff admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:26.315508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf67cd6-8a34-47ac-a759-baa48be4b4ff admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:26.337811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fd80e-58f9-43d8-a4e4-b459cb307006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:26.341655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fd80e-58f9-43d8-a4e4-b459cb307006 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:26.342025 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fd80e-58f9-43d8-a4e4-b459cb307006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:26.342415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fd80e-58f9-43d8-a4e4-b459cb307006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:26.346908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fd80e-58f9-43d8-a4e4-b459cb307006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:26.350937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fd80e-58f9-43d8-a4e4-b459cb307006 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:26.402243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 824/1656] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:26.405070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624cb4-092a-42fc-a0cf-1f77d4a3fd63 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:26.440207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624cb4-092a-42fc-a0cf-1f77d4a3fd63 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:26.457358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1792f0-f285-4832-bf59-6635bff58280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:26.459494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1792f0-f285-4832-bf59-6635bff58280 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:26.463322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1792f0-f285-4832-bf59-6635bff58280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:26.463973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1792f0-f285-4832-bf59-6635bff58280 admin admin] PATH_INFO: `/v3/projects/637a26f80d934f028383112a6831c683/users/d017ae6848284f0f9f40e2cd3748e008/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:26.531179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1792f0-f285-4832-bf59-6635bff58280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637a26f80d934f028383112a6831c683, user_id=d017ae6848284f0f9f40e2cd3748e008, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:26.551657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1792f0-f285-4832-bf59-6635bff58280 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:26.630060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 833/1657] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:26 2022] PUT /identity/v3/projects/637a26f80d934f028383112a6831c683/users/d017ae6848284f0f9f40e2cd3748e008/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:26.639156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97901003-c227-4e8e-8f67-694fbbcc9f02 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:26.639440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97901003-c227-4e8e-8f67-694fbbcc9f02 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:26.640238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97901003-c227-4e8e-8f67-694fbbcc9f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:26.711812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-97901003-c227-4e8e-8f67-694fbbcc9f02 None None] MFA Rules not processed for user `d017ae6848284f0f9f40e2cd3748e008`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:26.713837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-97901003-c227-4e8e-8f67-694fbbcc9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:26.915631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 825/1658] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:26.917286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1792f0-f285-4832-bf59-6635bff58280 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:27.168530 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1792f0-f285-4832-bf59-6635bff58280 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:27.184103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f069520-1420-4b86-a2ff-e62d48c3e370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:27.184803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069520-1420-4b86-a2ff-e62d48c3e370 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:27.185102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069520-1420-4b86-a2ff-e62d48c3e370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:27.185374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069520-1420-4b86-a2ff-e62d48c3e370 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:27.186058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f069520-1420-4b86-a2ff-e62d48c3e370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:27.188065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f069520-1420-4b86-a2ff-e62d48c3e370 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:27.262028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97901003-c227-4e8e-8f67-694fbbcc9f02 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:27.265116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-97901003-c227-4e8e-8f67-694fbbcc9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:27.274789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 834/1659] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:26 2022] POST /identity/v3/projects => generated 367 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:27.278284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f069520-1420-4b86-a2ff-e62d48c3e370 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:27.289882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97901003-c227-4e8e-8f67-694fbbcc9f02 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:27.305341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:27.471726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:27.549799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f069520-1420-4b86-a2ff-e62d48c3e370 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:27.565384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:27.566062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:27.566487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:27.567580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:27.569263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:27.572431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:27.613638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:27.616135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:27.616135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:27.616952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] PATH_INFO: `/v3/projects/bf0d469618064c61940540ee5912cbbe` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:27.620300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0d469618064c61940540ee5912cbbe)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:27.623883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:27.692705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 835/1660] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:27 2022] POST /identity/v3/users => generated 290 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:27.695715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:27.702619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:27.755555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9806d49-03e2-4bed-b37e-5116f8430e27 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:27.779908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0d469618064c61940540ee5912cbbe', 'request_id': 'req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:27.807346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0d469618064c61940540ee5912cbbe', 'request_id': 'req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:27.831749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0d469618064c61940540ee5912cbbe', 'request_id': 'req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:27.882019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] The token cache is being invalidate because project bf0d469618064c61940540ee5912cbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:27.882682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:27.884068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:27.888179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 826/1661] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:27 2022] DELETE /identity/v3/projects/bf0d469618064c61940540ee5912cbbe => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:27.890988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:27.898181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:28.004792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:28.010017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:28.010017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:28.010017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] PATH_INFO: `/v3/projects/b48d953efa39463cbda0858d2c1f1404` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:28.018109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48d953efa39463cbda0858d2c1f1404)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:28.027687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:28.212997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0adfd4-61a2-4f15-a3f5-86441b2c2a1a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:28.257892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48d953efa39463cbda0858d2c1f1404', 'request_id': 'req-d5d49443-e6d8-48c1-9978-1ae3747278c4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:28.279027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48d953efa39463cbda0858d2c1f1404', 'request_id': 'req-d5d49443-e6d8-48c1-9978-1ae3747278c4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:28.298271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48d953efa39463cbda0858d2c1f1404', 'request_id': 'req-d5d49443-e6d8-48c1-9978-1ae3747278c4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:28.333147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] The token cache is being invalidate because project b48d953efa39463cbda0858d2c1f1404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:28.333655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:28.334485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d5d49443-e6d8-48c1-9978-1ae3747278c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:28.336784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 836/1662] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:27 2022] DELETE /identity/v3/projects/b48d953efa39463cbda0858d2c1f1404 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:28.341810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1431d1-c707-4b29-830b-dc8f652e7de3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:28.342261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1431d1-c707-4b29-830b-dc8f652e7de3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:28.342514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1431d1-c707-4b29-830b-dc8f652e7de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:28.393128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3f1431d1-c707-4b29-830b-dc8f652e7de3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:28.400198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3f1431d1-c707-4b29-830b-dc8f652e7de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:28.450800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80350ee9-72c1-4515-b1ee-f8355a0853f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:28.451467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350ee9-72c1-4515-b1ee-f8355a0853f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:28.451746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350ee9-72c1-4515-b1ee-f8355a0853f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:28.452021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350ee9-72c1-4515-b1ee-f8355a0853f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:28.452775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80350ee9-72c1-4515-b1ee-f8355a0853f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:28.454533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80350ee9-72c1-4515-b1ee-f8355a0853f4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:28.474816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:28.495323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 827/1663] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 606 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:28.496999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b74af4-0003-4368-af01-d85b04abe463 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:28.497203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b74af4-0003-4368-af01-d85b04abe463 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:28.497325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b74af4-0003-4368-af01-d85b04abe463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:28.575738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d6b74af4-0003-4368-af01-d85b04abe463 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:28.577066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d6b74af4-0003-4368-af01-d85b04abe463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:28.595879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 837/1664] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:28.611701 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1431d1-c707-4b29-830b-dc8f652e7de3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:28.617248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 828/1665] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:28.625625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3f1431d1-c707-4b29-830b-dc8f652e7de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:28.632784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054d4d-811b-4306-bc96-44e6afa6bd01 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:28.635391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054d4d-811b-4306-bc96-44e6afa6bd01 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:28.637440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054d4d-811b-4306-bc96-44e6afa6bd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:28.650412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1431d1-c707-4b29-830b-dc8f652e7de3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:28.667379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ebd59-ba38-4610-bd61-7f702ee26ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:28.668082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ebd59-ba38-4610-bd61-7f702ee26ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:28.668358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ebd59-ba38-4610-bd61-7f702ee26ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:28.668636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ebd59-ba38-4610-bd61-7f702ee26ff8 admin admin] PATH_INFO: `/v3/projects/aad06177ce05493daa9d4f45189719fe/users/7e45d0e26c5643ddb0faf994997684bf/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:28.710691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ebd59-ba38-4610-bd61-7f702ee26ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad06177ce05493daa9d4f45189719fe, user_id=7e45d0e26c5643ddb0faf994997684bf, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:28.712617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f6054d4d-811b-4306-bc96-44e6afa6bd01 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:28.714505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ebd59-ba38-4610-bd61-7f702ee26ff8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:28.714711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f6054d4d-811b-4306-bc96-44e6afa6bd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:28.747685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 829/1666] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:28.751448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 838/1667] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:28 2022] PUT /identity/v3/projects/aad06177ce05493daa9d4f45189719fe/users/7e45d0e26c5643ddb0faf994997684bf/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:28.752875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d6996-6787-4030-9165-2ceee662b700 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:28.753162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d6996-6787-4030-9165-2ceee662b700 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:28.753433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d6996-6787-4030-9165-2ceee662b700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:28.760127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6054d4d-811b-4306-bc96-44e6afa6bd01 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:28.784109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6054d4d-811b-4306-bc96-44e6afa6bd01 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:28.797383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:28.823247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a08d6996-6787-4030-9165-2ceee662b700 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:28.826374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a08d6996-6787-4030-9165-2ceee662b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:29.023907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ac5f-d36e-4a2c-a475-b2350106b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.023907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ac5f-d36e-4a2c-a475-b2350106b547 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.023907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ac5f-d36e-4a2c-a475-b2350106b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.023907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ac5f-d36e-4a2c-a475-b2350106b547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.024661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ac5f-d36e-4a2c-a475-b2350106b547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.027020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ac5f-d36e-4a2c-a475-b2350106b547 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.084338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 839/1668] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:29.085573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d6996-6787-4030-9165-2ceee662b700 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.093700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 830/1669] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:29.093700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ac5f-d36e-4a2c-a475-b2350106b547 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.106411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d6996-6787-4030-9165-2ceee662b700 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.121243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.121903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.122186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.123332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.123332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:29.123634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.125185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.157069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 840/1670] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:29.158201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.167062 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ac5f-d36e-4a2c-a475-b2350106b547 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.179054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c040-7f5e-4364-ab6d-65e7c3250a74 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.186569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3892d1-37f9-4918-8f4d-251fb2e0512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.187709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3892d1-37f9-4918-8f4d-251fb2e0512f admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.188239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3892d1-37f9-4918-8f4d-251fb2e0512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.188938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3892d1-37f9-4918-8f4d-251fb2e0512f admin admin] PATH_INFO: `/v3/projects/aad06177ce05493daa9d4f45189719fe/users/7e45d0e26c5643ddb0faf994997684bf/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.197796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.198292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3892d1-37f9-4918-8f4d-251fb2e0512f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad06177ce05493daa9d4f45189719fe, user_id=7e45d0e26c5643ddb0faf994997684bf, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.198458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.198694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.198965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.199639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:29.199940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.201636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.208826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3892d1-37f9-4918-8f4d-251fb2e0512f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.232507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 841/1671] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:29.233322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.245767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 831/1672] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:29 2022] PUT /identity/v3/projects/aad06177ce05493daa9d4f45189719fe/users/7e45d0e26c5643ddb0faf994997684bf/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:29.246388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3892d1-37f9-4918-8f4d-251fb2e0512f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.253636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb7e29-e5e9-4d08-9978-2c8719f9a61b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.401963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17a47e-9808-4160-894b-8604ee4822df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.403484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17a47e-9808-4160-894b-8604ee4822df admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.403484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17a47e-9808-4160-894b-8604ee4822df admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.403988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17a47e-9808-4160-894b-8604ee4822df admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.405296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17a47e-9808-4160-894b-8604ee4822df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.409395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17a47e-9808-4160-894b-8604ee4822df admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.425162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3892d1-37f9-4918-8f4d-251fb2e0512f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.443986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5937429-07f7-4667-8497-96e807c28897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.445674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937429-07f7-4667-8497-96e807c28897 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.446760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937429-07f7-4667-8497-96e807c28897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.447237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937429-07f7-4667-8497-96e807c28897 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.448201 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5937429-07f7-4667-8497-96e807c28897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.451155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5937429-07f7-4667-8497-96e807c28897 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.515560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 842/1673] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:29 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:29.518018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 832/1674] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:29 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:29.519155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5937429-07f7-4667-8497-96e807c28897 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.520999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752369-f6c2-4961-90d0-c8961a1d3523 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.521300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752369-f6c2-4961-90d0-c8961a1d3523 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.523424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752369-f6c2-4961-90d0-c8961a1d3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.555143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:29.590970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-36752369-f6c2-4961-90d0-c8961a1d3523 None None] MFA Rules not processed for user `7e45d0e26c5643ddb0faf994997684bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:29.593376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-36752369-f6c2-4961-90d0-c8961a1d3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:29.746513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5937429-07f7-4667-8497-96e807c28897 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.748277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 843/1675] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:29.749259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36752369-f6c2-4961-90d0-c8961a1d3523 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.772341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.773046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.773333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.773621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.774316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.781341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36752369-f6c2-4961-90d0-c8961a1d3523 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.781608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.789445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c911f1-17d5-4afb-b5d5-a78988c30050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.790795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c911f1-17d5-4afb-b5d5-a78988c30050 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.791080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c911f1-17d5-4afb-b5d5-a78988c30050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.791356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c911f1-17d5-4afb-b5d5-a78988c30050 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.792817 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c911f1-17d5-4afb-b5d5-a78988c30050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.795035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c911f1-17d5-4afb-b5d5-a78988c30050 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.843474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 833/1676] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:29 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:29.844612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.846744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:29.858062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 844/1677] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:29 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:29.858948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c911f1-17d5-4afb-b5d5-a78988c30050 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.866036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:29.898213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c911f1-17d5-4afb-b5d5-a78988c30050 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.914265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa885f74-f4dc-4b6e-a826-b7f9c9ee9586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.916723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa885f74-f4dc-4b6e-a826-b7f9c9ee9586 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.917030 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa885f74-f4dc-4b6e-a826-b7f9c9ee9586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.917399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa885f74-f4dc-4b6e-a826-b7f9c9ee9586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.918000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa885f74-f4dc-4b6e-a826-b7f9c9ee9586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.925679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa885f74-f4dc-4b6e-a826-b7f9c9ee9586 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.939073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b8415-bdac-4362-8d0c-8e0fcf178c6c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:29.948016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 845/1678] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:29.950008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa885f74-f4dc-4b6e-a826-b7f9c9ee9586 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:29.952358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3ea9d-1c02-4791-a7e3-f7b308131ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:29.953323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ea9d-1c02-4791-a7e3-f7b308131ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:29.953740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ea9d-1c02-4791-a7e3-f7b308131ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:29.954146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3ea9d-1c02-4791-a7e3-f7b308131ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:29.980013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3ea9d-1c02-4791-a7e3-f7b308131ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:29.982734 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3ea9d-1c02-4791-a7e3-f7b308131ee2 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:29.989854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa885f74-f4dc-4b6e-a826-b7f9c9ee9586 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:30.009025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd4ce1-bedd-42ae-8a37-01250578f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:30.012441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd4ce1-bedd-42ae-8a37-01250578f90b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.012866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd4ce1-bedd-42ae-8a37-01250578f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.013305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd4ce1-bedd-42ae-8a37-01250578f90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.017512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd4ce1-bedd-42ae-8a37-01250578f90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:30.025696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd4ce1-bedd-42ae-8a37-01250578f90b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:30.043846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 834/1679] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:30.046574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3ea9d-1c02-4791-a7e3-f7b308131ee2 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:30.085239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 846/1680] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:30.086479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd4ce1-bedd-42ae-8a37-01250578f90b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:30.088161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3ea9d-1c02-4791-a7e3-f7b308131ee2 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:30.119369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9a2de-c676-48c2-b591-c668ba48d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:30.120512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9a2de-c676-48c2-b591-c668ba48d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.120968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9a2de-c676-48c2-b591-c668ba48d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.121250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9a2de-c676-48c2-b591-c668ba48d7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.122009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9a2de-c676-48c2-b591-c668ba48d7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:30.125690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd4ce1-bedd-42ae-8a37-01250578f90b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:30.126252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9a2de-c676-48c2-b591-c668ba48d7bd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:30.153445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec684-cf47-40d4-ad2a-bf5814839b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:30.154073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec684-cf47-40d4-ad2a-bf5814839b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.154356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec684-cf47-40d4-ad2a-bf5814839b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.154628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec684-cf47-40d4-ad2a-bf5814839b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.155438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec684-cf47-40d4-ad2a-bf5814839b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:30.158018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec684-cf47-40d4-ad2a-bf5814839b01 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:30.166601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 835/1681] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:30.168050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202eb3-d458-4c16-a7ad-e23a1e512388 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.168339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202eb3-d458-4c16-a7ad-e23a1e512388 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.168644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202eb3-d458-4c16-a7ad-e23a1e512388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.185903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 847/1682] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:30.186882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec684-cf47-40d4-ad2a-bf5814839b01 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:30.228433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec684-cf47-40d4-ad2a-bf5814839b01 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:30.231208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fd202eb3-d458-4c16-a7ad-e23a1e512388 None None] MFA Rules not processed for user `ca505faad29a4155a9c4f562b2b47dee`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:30.236525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f782b90-67b6-4b3c-99b1-155d61a5951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:30.236733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fd202eb3-d458-4c16-a7ad-e23a1e512388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:30.237657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782b90-67b6-4b3c-99b1-155d61a5951b admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.238207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782b90-67b6-4b3c-99b1-155d61a5951b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.238653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f782b90-67b6-4b3c-99b1-155d61a5951b admin admin] PATH_INFO: `/v3/projects/6a0fac78b85241b6a627953e0401ff05/users/974f30a1c19744dfa2d46bbe94b1f218/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.269102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f782b90-67b6-4b3c-99b1-155d61a5951b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0fac78b85241b6a627953e0401ff05, user_id=974f30a1c19744dfa2d46bbe94b1f218, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:30.281132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f782b90-67b6-4b3c-99b1-155d61a5951b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:30.306193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 848/1683] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:30 2022] PUT /identity/v3/projects/6a0fac78b85241b6a627953e0401ff05/users/974f30a1c19744dfa2d46bbe94b1f218/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:30.307500 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f782b90-67b6-4b3c-99b1-155d61a5951b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:30.450214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 836/1684] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:30.451991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283390a-be18-4b4f-8982-d9ecde7b3d6a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.453899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283390a-be18-4b4f-8982-d9ecde7b3d6a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.456915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283390a-be18-4b4f-8982-d9ecde7b3d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.515947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f782b90-67b6-4b3c-99b1-155d61a5951b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:30.518374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7283390a-be18-4b4f-8982-d9ecde7b3d6a None None] MFA Rules not processed for user `974f30a1c19744dfa2d46bbe94b1f218`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:30.519837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7283390a-be18-4b4f-8982-d9ecde7b3d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:30.530950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a8b5e-ab4b-4c24-b868-d38283cd9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:30.532914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a8b5e-ab4b-4c24-b868-d38283cd9014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.535684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a8b5e-ab4b-4c24-b868-d38283cd9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.537357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a8b5e-ab4b-4c24-b868-d38283cd9014 admin admin] PATH_INFO: `/v3/projects/17c3f7d40153409387d92b8d1c104c98/users/275e92c65b80498c843c2ad41af70689/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.601885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a8b5e-ab4b-4c24-b868-d38283cd9014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c3f7d40153409387d92b8d1c104c98, user_id=275e92c65b80498c843c2ad41af70689, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:30.610971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a8b5e-ab4b-4c24-b868-d38283cd9014 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:30.639041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:30.668294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 849/1685] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:30 2022] PUT /identity/v3/projects/17c3f7d40153409387d92b8d1c104c98/users/275e92c65b80498c843c2ad41af70689/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:30.668294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b956e-9fd0-4433-b8f9-75d8f685655d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.668294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b956e-9fd0-4433-b8f9-75d8f685655d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.668294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b956e-9fd0-4433-b8f9-75d8f685655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.708270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c83b956e-9fd0-4433-b8f9-75d8f685655d None None] MFA Rules not processed for user `ca505faad29a4155a9c4f562b2b47dee`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:30.709713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c83b956e-9fd0-4433-b8f9-75d8f685655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:30.789296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 837/1686] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:30.790345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283390a-be18-4b4f-8982-d9ecde7b3d6a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:30.798000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7283390a-be18-4b4f-8982-d9ecde7b3d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:30.826530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283390a-be18-4b4f-8982-d9ecde7b3d6a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:30.868512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:30.904438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 850/1687] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:30.906352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca230c1-42f3-4c0c-b57e-06a5f74d787c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:30.907474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca230c1-42f3-4c0c-b57e-06a5f74d787c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:30.909250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca230c1-42f3-4c0c-b57e-06a5f74d787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:30.985525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9ca230c1-42f3-4c0c-b57e-06a5f74d787c None None] MFA Rules not processed for user `275e92c65b80498c843c2ad41af70689`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:30.987696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9ca230c1-42f3-4c0c-b57e-06a5f74d787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.009426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:31.010163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:31.010454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:31.010770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] PATH_INFO: `/v3/users/e50e7b34b8d84a86ac58d892ff5fbdb2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:31.014981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50e7b34b8d84a86ac58d892ff5fbdb2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:31.018119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:31.132939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50e7b34b8d84a86ac58d892ff5fbdb2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:31.152975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50e7b34b8d84a86ac58d892ff5fbdb2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:31.153873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50e7b34b8d84a86ac58d892ff5fbdb2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:31.154516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50e7b34b8d84a86ac58d892ff5fbdb2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:31.156311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 851/1688] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:31.161608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca230c1-42f3-4c0c-b57e-06a5f74d787c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:31.163713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9ca230c1-42f3-4c0c-b57e-06a5f74d787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.168925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50e7b34b8d84a86ac58d892ff5fbdb2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:31.212603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 838/1689] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:30 2022] DELETE /identity/v3/users/e50e7b34b8d84a86ac58d892ff5fbdb2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:31.218304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:31.226190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.320094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca230c1-42f3-4c0c-b57e-06a5f74d787c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:31.408318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687a38-18a0-4a33-9e70-f1f61e45c384 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:31.426304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:31.433100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:31.434629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:31.438124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:31.441061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9e48f-0eee-4691-b5f7-2e6597fc2e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:31.441907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9e48f-0eee-4691-b5f7-2e6597fc2e79 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:31.442284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9e48f-0eee-4691-b5f7-2e6597fc2e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:31.442652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9e48f-0eee-4691-b5f7-2e6597fc2e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:31.444709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.450692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-73d9e48f-0eee-4691-b5f7-2e6597fc2e79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.459087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:31.536548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:31.615663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:31.618644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:31.647046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 839/1690] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:31.648087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:31.649499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.692798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9e48f-0eee-4691-b5f7-2e6597fc2e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:31.701774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9e48f-0eee-4691-b5f7-2e6597fc2e79 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:31.752936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 852/1691] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:31.754783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eeb24-1a7c-47de-a1d0-9f847ebf3297 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:31.772080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eeb24-1a7c-47de-a1d0-9f847ebf3297 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:31.772627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eeb24-1a7c-47de-a1d0-9f847ebf3297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:31.805514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05155a95-04f1-42c3-8217-53a4c002b7b8 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:31.818991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:31.819646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:31.819920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:31.820200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:31.820892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:31.824083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:31.827667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3a7eeb24-1a7c-47de-a1d0-9f847ebf3297 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:31.828973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3a7eeb24-1a7c-47de-a1d0-9f847ebf3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.848454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 853/1692] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:31.849074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eeb24-1a7c-47de-a1d0-9f847ebf3297 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:31.867945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3a7eeb24-1a7c-47de-a1d0-9f847ebf3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.939576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eeb24-1a7c-47de-a1d0-9f847ebf3297 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:31.953840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 840/1693] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:31 2022] POST /identity/v3/projects => generated 363 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:31.955650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:31.964066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:31.964617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:31.966883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:31.967348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:31.967742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] PATH_INFO: `/v3/users/974f30a1c19744dfa2d46bbe94b1f218` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:31.971384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=974f30a1c19744dfa2d46bbe94b1f218)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:31.978211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:32.099273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974f30a1c19744dfa2d46bbe94b1f218'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:32.134713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974f30a1c19744dfa2d46bbe94b1f218'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:32.148623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816829-b67f-47e0-a06c-d13637e8370b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:32.158221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974f30a1c19744dfa2d46bbe94b1f218'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:32.159264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974f30a1c19744dfa2d46bbe94b1f218'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:32.160596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9836a-614a-45df-af77-5e9347d931ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:32.161436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9836a-614a-45df-af77-5e9347d931ee service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:32.161808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9836a-614a-45df-af77-5e9347d931ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:32.162031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b24daef7-aff1-4dee-9498-343629e74775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974f30a1c19744dfa2d46bbe94b1f218'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:32.162154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9836a-614a-45df-af77-5e9347d931ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:32.164204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b7d9836a-614a-45df-af77-5e9347d931ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:32.202726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 854/1694] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:31 2022] DELETE /identity/v3/users/974f30a1c19744dfa2d46bbe94b1f218 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:32.207179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee2638-9cc9-4afb-af00-46ee3fc2cd0c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:32.208058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee2638-9cc9-4afb-af00-46ee3fc2cd0c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:32.209210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee2638-9cc9-4afb-af00-46ee3fc2cd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:32.303713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a0ee2638-9cc9-4afb-af00-46ee3fc2cd0c None None] MFA Rules not processed for user `452b906a5338428d8fc824ddff2093e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:32.306191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a0ee2638-9cc9-4afb-af00-46ee3fc2cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:32.462992 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9836a-614a-45df-af77-5e9347d931ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:32.465378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9836a-614a-45df-af77-5e9347d931ee service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:32.486891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:32.504339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 855/1695] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:32.504339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee2638-9cc9-4afb-af00-46ee3fc2cd0c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:32.507858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a0ee2638-9cc9-4afb-af00-46ee3fc2cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:32.530606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 841/1696] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:32.546582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a72eb-2cd3-4091-9b8d-992b9e265513 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:32.547396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a72eb-2cd3-4091-9b8d-992b9e265513 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:32.548092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a72eb-2cd3-4091-9b8d-992b9e265513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:32.633849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c65a72eb-2cd3-4091-9b8d-992b9e265513 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:32.635275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c65a72eb-2cd3-4091-9b8d-992b9e265513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:32.650350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:32.695387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee2638-9cc9-4afb-af00-46ee3fc2cd0c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:32.713332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:32.714207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:32.714592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:32.715000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:32.715745 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:32.718386 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:32.783886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 856/1697] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:32 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:32.787270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:32.790309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:32.805370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 842/1698] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:32.806463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a72eb-2cd3-4091-9b8d-992b9e265513 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:32.834162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a72eb-2cd3-4091-9b8d-992b9e265513 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:32.853400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:32.854097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:32.854495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:32.855248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:32.855729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:32.863973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:32.895537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 843/1699] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:32.896676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:32.906149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:33.086147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1d19-9ff3-4973-8137-112e6e8853fb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:33.094435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ee9b-3eee-40fd-841b-ef57f847457c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:33.104131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80530-44b1-4100-b9ea-63210102fd4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:33.105688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80530-44b1-4100-b9ea-63210102fd4f service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:33.105688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80530-44b1-4100-b9ea-63210102fd4f service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:33.105688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80530-44b1-4100-b9ea-63210102fd4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:33.110095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fff65-2990-4f3a-a63f-cce607aef08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:33.112004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fff65-2990-4f3a-a63f-cce607aef08c service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:33.112456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fff65-2990-4f3a-a63f-cce607aef08c service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:33.112889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fff65-2990-4f3a-a63f-cce607aef08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:33.126450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa80530-44b1-4100-b9ea-63210102fd4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:33.129117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa80530-44b1-4100-b9ea-63210102fd4f service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:33.141195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fff65-2990-4f3a-a63f-cce607aef08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:33.145763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fff65-2990-4f3a-a63f-cce607aef08c service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:33.153212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 857/1700] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:33.154158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80530-44b1-4100-b9ea-63210102fd4f service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:33.176147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 844/1701] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:33.179643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80530-44b1-4100-b9ea-63210102fd4f service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:33.196328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae0911-d569-496e-b362-4aa9245a4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:33.197079 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0911-d569-496e-b362-4aa9245a4b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:33.197370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0911-d569-496e-b362-4aa9245a4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:33.197699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0911-d569-496e-b362-4aa9245a4b25 admin admin] PATH_INFO: `/v3/projects/9edd43111c844be5a01ecbe4708af299/users/4ea3ae419af744f49581ea3652580140/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:33.233362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae0911-d569-496e-b362-4aa9245a4b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edd43111c844be5a01ecbe4708af299, user_id=4ea3ae419af744f49581ea3652580140, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:33.239706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae0911-d569-496e-b362-4aa9245a4b25 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:33.271813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 858/1702] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:33 2022] PUT /identity/v3/projects/9edd43111c844be5a01ecbe4708af299/users/4ea3ae419af744f49581ea3652580140/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:33.277036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fff65-2990-4f3a-a63f-cce607aef08c service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:33.295312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fff65-2990-4f3a-a63f-cce607aef08c service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:33.426087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a7f8-38ed-4778-90b5-02cb3359baa5 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:33.426606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a7f8-38ed-4778-90b5-02cb3359baa5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:33.427111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a7f8-38ed-4778-90b5-02cb3359baa5 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:33.431091 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 859/1703] 10.222.0.55 () {54 vars in 912 bytes} [Tue Sep 13 12:32:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:32:33.459910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50e5a6-34e4-4592-80b6-b44c61be7481 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:33.460223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50e5a6-34e4-4592-80b6-b44c61be7481 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:33.460620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50e5a6-34e4-4592-80b6-b44c61be7481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:33.557502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6a50e5a6-34e4-4592-80b6-b44c61be7481 None None] MFA Rules not processed for user `b310f17f81e040ac80dc1b9de52026f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:33.560540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6a50e5a6-34e4-4592-80b6-b44c61be7481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:33.606460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafaade-cc2b-4642-982b-4e001ce10812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:33.609501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafaade-cc2b-4642-982b-4e001ce10812 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:33.609793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafaade-cc2b-4642-982b-4e001ce10812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:33.611343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafaade-cc2b-4642-982b-4e001ce10812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:33.612163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafaade-cc2b-4642-982b-4e001ce10812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:33.616339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafaade-cc2b-4642-982b-4e001ce10812 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:33.647689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 845/1704] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:32:33.652087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafaade-cc2b-4642-982b-4e001ce10812 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:33.671923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:33.678041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafaade-cc2b-4642-982b-4e001ce10812 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:33.693273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea6723-1dd5-4998-9a73-1c92d3df3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:33.693995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6723-1dd5-4998-9a73-1c92d3df3d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:33.694283 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6723-1dd5-4998-9a73-1c92d3df3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:33.694568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6723-1dd5-4998-9a73-1c92d3df3d35 admin admin] PATH_INFO: `/v3/projects/9edd43111c844be5a01ecbe4708af299/users/4ea3ae419af744f49581ea3652580140/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:33.697831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea6723-1dd5-4998-9a73-1c92d3df3d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edd43111c844be5a01ecbe4708af299, user_id=4ea3ae419af744f49581ea3652580140, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:33.705101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea6723-1dd5-4998-9a73-1c92d3df3d35 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:33.745464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 846/1705] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:33 2022] PUT /identity/v3/projects/9edd43111c844be5a01ecbe4708af299/users/4ea3ae419af744f49581ea3652580140/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:33.747066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baaf41-db6c-4cc5-a7d3-1fecce930397 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:33.747364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baaf41-db6c-4cc5-a7d3-1fecce930397 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:33.747643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baaf41-db6c-4cc5-a7d3-1fecce930397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:33.762887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 860/1706] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:33.808732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-60baaf41-db6c-4cc5-a7d3-1fecce930397 None None] MFA Rules not processed for user `4ea3ae419af744f49581ea3652580140`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:33.810524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-60baaf41-db6c-4cc5-a7d3-1fecce930397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:33.836324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:33.868279 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50e5a6-34e4-4592-80b6-b44c61be7481 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:33.890649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50e5a6-34e4-4592-80b6-b44c61be7481 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:34.077923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 847/1707] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:34.081119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baaf41-db6c-4cc5-a7d3-1fecce930397 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:34.084628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-60baaf41-db6c-4cc5-a7d3-1fecce930397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:34.137200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:34.138188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:34.138646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:34.139331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:34.189366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:34.193399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:34.245174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 861/1708] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:34.248687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:34.252848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baaf41-db6c-4cc5-a7d3-1fecce930397 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:34.255054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:34.274298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:34.279159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:34.281018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:34.282934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] PATH_INFO: `/v3/users/d017ae6848284f0f9f40e2cd3748e008` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:34.289534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d017ae6848284f0f9f40e2cd3748e008)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:34.293200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:34.478959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd017ae6848284f0f9f40e2cd3748e008'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:34.483468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f93f03-c01a-4a5c-9e3c-ad0d04e3a42d service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:34.491261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614fb6a-beb1-4b98-9cf9-ef8d48059a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:34.492761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614fb6a-beb1-4b98-9cf9-ef8d48059a6f service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:34.493409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614fb6a-beb1-4b98-9cf9-ef8d48059a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:34.493765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614fb6a-beb1-4b98-9cf9-ef8d48059a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:34.502003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd017ae6848284f0f9f40e2cd3748e008'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:34.502784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd017ae6848284f0f9f40e2cd3748e008'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:34.503889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd017ae6848284f0f9f40e2cd3748e008'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:34.516441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614fb6a-beb1-4b98-9cf9-ef8d48059a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:34.520482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614fb6a-beb1-4b98-9cf9-ef8d48059a6f service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:34.520917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd017ae6848284f0f9f40e2cd3748e008'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:34.541362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 862/1709] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:34.590618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 848/1710] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:34 2022] DELETE /identity/v3/users/d017ae6848284f0f9f40e2cd3748e008 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:34.595973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16dd8b-243e-4de7-981e-7d94dc7d570c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:34.596958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16dd8b-243e-4de7-981e-7d94dc7d570c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:34.597737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16dd8b-243e-4de7-981e-7d94dc7d570c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:34.670484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-de16dd8b-243e-4de7-981e-7d94dc7d570c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:34.674231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-de16dd8b-243e-4de7-981e-7d94dc7d570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:34.890757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 863/1711] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:35.012979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:35.015438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:35.118809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:35.293175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea06f91-1f63-4e0d-9a52-97e7d00bda3e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:35.333214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:35.343647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:35.344978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:35.347414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:35.375123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:35.382753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:35.417324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 849/1712] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:35.435909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16dd8b-243e-4de7-981e-7d94dc7d570c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:35.440747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-de16dd8b-243e-4de7-981e-7d94dc7d570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:35.474031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16dd8b-243e-4de7-981e-7d94dc7d570c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:35.517570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:35.522458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:35.523271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:35.523683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] PATH_INFO: `/v3/projects/6a0fac78b85241b6a627953e0401ff05` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:35.528519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0fac78b85241b6a627953e0401ff05)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:35.530981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:35.690009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:35.708851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:35.710874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:35.742206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0fac78b85241b6a627953e0401ff05', 'request_id': 'req-720892e0-3f17-4a55-984c-5191523cd00f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:35.751037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451e76c-3938-44dd-ab8f-a34e55bc1a6f service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:35.772442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0fac78b85241b6a627953e0401ff05', 'request_id': 'req-720892e0-3f17-4a55-984c-5191523cd00f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:35.789630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0fac78b85241b6a627953e0401ff05', 'request_id': 'req-720892e0-3f17-4a55-984c-5191523cd00f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:35.814572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] The token cache is being invalidate because project 6a0fac78b85241b6a627953e0401ff05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:35.814572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:35.816877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-720892e0-3f17-4a55-984c-5191523cd00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:35.823349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 864/1713] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:35 2022] DELETE /identity/v3/projects/6a0fac78b85241b6a627953e0401ff05 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:35.828366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6443-eab0-412c-aa94-4cf0fa73e348 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:35.828654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6443-eab0-412c-aa94-4cf0fa73e348 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:35.828933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6443-eab0-412c-aa94-4cf0fa73e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:35.886248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0dee6443-eab0-412c-aa94-4cf0fa73e348 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:35.887679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0dee6443-eab0-412c-aa94-4cf0fa73e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:35.931534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:35.932377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:35.933343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:35.933637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] PATH_INFO: `/v3/users/275e92c65b80498c843c2ad41af70689` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:35.938005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] RBAC: Authorizing `identity:delete_user(user_id=275e92c65b80498c843c2ad41af70689)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:35.945018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:36.070621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275e92c65b80498c843c2ad41af70689'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.085794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 865/1714] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:36.095929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275e92c65b80498c843c2ad41af70689'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.097665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7ed68-25f1-4b24-a2a5-d077675eea8e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:36.098028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7ed68-25f1-4b24-a2a5-d077675eea8e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:36.098163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275e92c65b80498c843c2ad41af70689'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.098444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7ed68-25f1-4b24-a2a5-d077675eea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:36.099410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275e92c65b80498c843c2ad41af70689'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.109575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3bb4e5e7-a8c6-4176-b4e2-49e3c3a9e00f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275e92c65b80498c843c2ad41af70689'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.158680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dba7ed68-25f1-4b24-a2a5-d077675eea8e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:36.162799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 850/1715] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:35 2022] DELETE /identity/v3/users/275e92c65b80498c843c2ad41af70689 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:36.165912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198de33-1b16-4ed9-b538-0d1bdecb01ce None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:36.166710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198de33-1b16-4ed9-b538-0d1bdecb01ce None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:36.166984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198de33-1b16-4ed9-b538-0d1bdecb01ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:36.167679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dba7ed68-25f1-4b24-a2a5-d077675eea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:36.234942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3198de33-1b16-4ed9-b538-0d1bdecb01ce None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:36.241166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3198de33-1b16-4ed9-b538-0d1bdecb01ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:36.366265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 866/1716] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:36.370407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7ed68-25f1-4b24-a2a5-d077675eea8e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:36.386954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:36.399933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7ed68-25f1-4b24-a2a5-d077675eea8e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:36.415370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:36.417589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:36.419740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:36.419875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:36.428681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:36.429898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:36.432415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:36.436660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 851/1717] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:36.444561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198de33-1b16-4ed9-b538-0d1bdecb01ce None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:36.444940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3198de33-1b16-4ed9-b538-0d1bdecb01ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:36.469850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 867/1718] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:32:36.475325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:36.477325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198de33-1b16-4ed9-b538-0d1bdecb01ce None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:36.511324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:36.512032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:36.512352 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:36.512656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] PATH_INFO: `/v3/projects/8e360fc2c5084778bc9fcbce91b4e52f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:36.519487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc348b5e-b682-4f4a-bfc8-0172d3ff9a50 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:36.521744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e360fc2c5084778bc9fcbce91b4e52f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:36.523794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:36.536190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:36.537074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:36.537361 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:36.537640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:36.539258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:36.547790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:36.658488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 868/1719] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:36 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:36.659822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:36.669383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:36.722017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e360fc2c5084778bc9fcbce91b4e52f', 'request_id': 'req-6938fb5d-777d-424d-9aa4-5a3bc27edaee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.741831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e360fc2c5084778bc9fcbce91b4e52f', 'request_id': 'req-6938fb5d-777d-424d-9aa4-5a3bc27edaee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.758622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:36.767603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e360fc2c5084778bc9fcbce91b4e52f', 'request_id': 'req-6938fb5d-777d-424d-9aa4-5a3bc27edaee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.788407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] The token cache is being invalidate because project 8e360fc2c5084778bc9fcbce91b4e52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:36.788967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.795034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:36.801486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 852/1720] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:36 2022] DELETE /identity/v3/projects/8e360fc2c5084778bc9fcbce91b4e52f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:36.802963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:36.805879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:36.876373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932b360-1a5a-4336-b8eb-127d40ae4ad8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:37.015538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:37.016290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.016602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.016876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.020912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:37.063510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938fb5d-777d-424d-9aa4-5a3bc27edaee admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:37.087223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e326e-3c63-4b15-a2b1-e2f5aacd56e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:37.088114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e326e-3c63-4b15-a2b1-e2f5aacd56e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.088623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e326e-3c63-4b15-a2b1-e2f5aacd56e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.091694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e326e-3c63-4b15-a2b1-e2f5aacd56e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.092591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e326e-3c63-4b15-a2b1-e2f5aacd56e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:37.097345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e326e-3c63-4b15-a2b1-e2f5aacd56e9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:37.157925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 853/1721] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:36 2022] POST /identity/v3/users => generated 289 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:37.159095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7feb7-90da-4e83-a4a4-d00c2bc22e8c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.159404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7feb7-90da-4e83-a4a4-d00c2bc22e8c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.159789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7feb7-90da-4e83-a4a4-d00c2bc22e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.240867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:37.242857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:37.273103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-aaf7feb7-90da-4e83-a4a4-d00c2bc22e8c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:37.275026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-aaf7feb7-90da-4e83-a4a4-d00c2bc22e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:37.288682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 869/1722] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:37.292266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:37.322406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 854/1723] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:37.324156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b0ec7-4b55-4b96-83e8-426059c9a69d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.324473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b0ec7-4b55-4b96-83e8-426059c9a69d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.324752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b0ec7-4b55-4b96-83e8-426059c9a69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.331194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bb53b-dbe4-41bd-be7d-dd46dc227a12 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:37.352258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90b006-67d7-49b9-ba3e-8d385a313532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:37.355790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b006-67d7-49b9-ba3e-8d385a313532 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.355790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b006-67d7-49b9-ba3e-8d385a313532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.356165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b006-67d7-49b9-ba3e-8d385a313532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.356916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90b006-67d7-49b9-ba3e-8d385a313532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:37.358554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90b006-67d7-49b9-ba3e-8d385a313532 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:37.361548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cf2b0ec7-4b55-4b96-83e8-426059c9a69d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:37.362908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cf2b0ec7-4b55-4b96-83e8-426059c9a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:37.399011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 855/1724] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:37.399011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b0ec7-4b55-4b96-83e8-426059c9a69d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:37.402636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cf2b0ec7-4b55-4b96-83e8-426059c9a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:37.415396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 870/1725] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:37.417445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90b006-67d7-49b9-ba3e-8d385a313532 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:37.461903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90b006-67d7-49b9-ba3e-8d385a313532 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:37.479268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:37.484116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.484636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.485085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.488304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:37.489187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:37.491203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:37.546489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 871/1726] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:37.549217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:37.583129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:37.590773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699527-000d-4a60-9ba1-72bf8774d315 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:37.611504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197cd9-6eea-4ccf-bd5d-6daaeb75af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:37.612281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197cd9-6eea-4ccf-bd5d-6daaeb75af82 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.612553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197cd9-6eea-4ccf-bd5d-6daaeb75af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.613787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197cd9-6eea-4ccf-bd5d-6daaeb75af82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.613787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5197cd9-6eea-4ccf-bd5d-6daaeb75af82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:37.615226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5197cd9-6eea-4ccf-bd5d-6daaeb75af82 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:37.667318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 872/1727] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:37.668524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b0ec7-4b55-4b96-83e8-426059c9a69d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:37.669309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197cd9-6eea-4ccf-bd5d-6daaeb75af82 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:37.691718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:37.693595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.693919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.694270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.702019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:37.710643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197cd9-6eea-4ccf-bd5d-6daaeb75af82 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:37.736203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80eb95-7db4-418d-90ac-2c46891deac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:37.736813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80eb95-7db4-418d-90ac-2c46891deac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.737053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80eb95-7db4-418d-90ac-2c46891deac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.738190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80eb95-7db4-418d-90ac-2c46891deac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.738190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80eb95-7db4-418d-90ac-2c46891deac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:37.741048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80eb95-7db4-418d-90ac-2c46891deac7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:37.742676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:37.744270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:37.795756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 856/1728] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:37.796729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:37.845730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6594b-1ceb-4ea4-b8b4-328cff301a9b service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:37.857450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200541d5-ba03-4e0e-8474-6bc2422c4a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:37.861176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200541d5-ba03-4e0e-8474-6bc2422c4a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.861176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200541d5-ba03-4e0e-8474-6bc2422c4a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.861176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200541d5-ba03-4e0e-8474-6bc2422c4a5c admin admin] PATH_INFO: `/v3/projects/d32acacd82434e3fba1522efaa3f0ba6/users/b5bcba78765a4402a6dc0fcf4961bd17/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:37.869774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 873/1729] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:37 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:37.872933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80eb95-7db4-418d-90ac-2c46891deac7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:37.931881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200541d5-ba03-4e0e-8474-6bc2422c4a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32acacd82434e3fba1522efaa3f0ba6, user_id=b5bcba78765a4402a6dc0fcf4961bd17, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:37.933657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200541d5-ba03-4e0e-8474-6bc2422c4a5c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:37.975750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 857/1730] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:37 2022] PUT /identity/v3/projects/d32acacd82434e3fba1522efaa3f0ba6/users/b5bcba78765a4402a6dc0fcf4961bd17/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:37.984346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:37.998458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936289-4c62-4b64-80d1-c811a1e428ee None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:37.998943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936289-4c62-4b64-80d1-c811a1e428ee None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:37.999507 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936289-4c62-4b64-80d1-c811a1e428ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:38.028122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80eb95-7db4-418d-90ac-2c46891deac7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:38.068632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6e936289-4c62-4b64-80d1-c811a1e428ee None None] MFA Rules not processed for user `b5bcba78765a4402a6dc0fcf4961bd17`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:38.071386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6e936289-4c62-4b64-80d1-c811a1e428ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:38.181163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc578d52-69e9-40c3-a81c-6d5629cc9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:38.181824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578d52-69e9-40c3-a81c-6d5629cc9913 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:38.182101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578d52-69e9-40c3-a81c-6d5629cc9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:38.182368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578d52-69e9-40c3-a81c-6d5629cc9913 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:38.183023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc578d52-69e9-40c3-a81c-6d5629cc9913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:38.185125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc578d52-69e9-40c3-a81c-6d5629cc9913 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:38.240546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 874/1731] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:37 2022] POST /identity/v3/users => generated 286 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:38.244430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc578d52-69e9-40c3-a81c-6d5629cc9913 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:38.273206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc578d52-69e9-40c3-a81c-6d5629cc9913 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:38.287312 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5736a34-5a75-4eac-a310-e68b9460665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:38.287982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5736a34-5a75-4eac-a310-e68b9460665f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:38.288240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5736a34-5a75-4eac-a310-e68b9460665f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:38.288542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5736a34-5a75-4eac-a310-e68b9460665f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:38.289404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5736a34-5a75-4eac-a310-e68b9460665f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:38.299515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5736a34-5a75-4eac-a310-e68b9460665f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:38.334681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 875/1732] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:38.334681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5736a34-5a75-4eac-a310-e68b9460665f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:38.351666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5736a34-5a75-4eac-a310-e68b9460665f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:38.375577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a367576-abb8-47c1-aa45-07da61590f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:38.376252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367576-abb8-47c1-aa45-07da61590f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:38.376568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367576-abb8-47c1-aa45-07da61590f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:38.376840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367576-abb8-47c1-aa45-07da61590f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:38.377709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a367576-abb8-47c1-aa45-07da61590f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:38.380001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a367576-abb8-47c1-aa45-07da61590f90 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:38.405974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 876/1733] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:32:38.406807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a367576-abb8-47c1-aa45-07da61590f90 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:38.418680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 858/1734] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:38.425756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e936289-4c62-4b64-80d1-c811a1e428ee None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:38.434411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a367576-abb8-47c1-aa45-07da61590f90 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:38.449258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6305-36b3-4f3c-b7be-77fa3b7d731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:38.449976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6305-36b3-4f3c-b7be-77fa3b7d731c admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:38.450255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6305-36b3-4f3c-b7be-77fa3b7d731c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:38.450558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6305-36b3-4f3c-b7be-77fa3b7d731c admin admin] PATH_INFO: `/v3/projects/a834413b79394b0eb7ea84be794dfcef/users/ea6fca7a943b4f2388e1aae330d91a1c/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:38.475952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e936289-4c62-4b64-80d1-c811a1e428ee None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:38.493050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3d742-1f4f-403f-928d-4f2b24d41a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:38.494646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3d742-1f4f-403f-928d-4f2b24d41a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:38.496879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3d742-1f4f-403f-928d-4f2b24d41a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:38.497109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3d742-1f4f-403f-928d-4f2b24d41a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:38.497826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3d742-1f4f-403f-928d-4f2b24d41a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:38.500118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3d742-1f4f-403f-928d-4f2b24d41a89 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:38.507471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6305-36b3-4f3c-b7be-77fa3b7d731c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a834413b79394b0eb7ea84be794dfcef, user_id=ea6fca7a943b4f2388e1aae330d91a1c, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:38.510693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6305-36b3-4f3c-b7be-77fa3b7d731c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:38.545359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 877/1735] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:38 2022] PUT /identity/v3/projects/a834413b79394b0eb7ea84be794dfcef/users/ea6fca7a943b4f2388e1aae330d91a1c/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:38.557912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d82c-b0a7-4c1c-af93-f10928331fbe None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:38.558197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d82c-b0a7-4c1c-af93-f10928331fbe None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:38.564040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d82c-b0a7-4c1c-af93-f10928331fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:38.637603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 859/1736] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:38 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:38.639187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3d742-1f4f-403f-928d-4f2b24d41a89 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:38.695595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5482d82c-b0a7-4c1c-af93-f10928331fbe None None] MFA Rules not processed for user `ea6fca7a943b4f2388e1aae330d91a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:38.703732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5482d82c-b0a7-4c1c-af93-f10928331fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:38.959423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3d742-1f4f-403f-928d-4f2b24d41a89 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:38.977532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326a370-7598-441f-88b5-51da26e2968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:38.978213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326a370-7598-441f-88b5-51da26e2968d admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:38.978496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326a370-7598-441f-88b5-51da26e2968d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:38.978776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326a370-7598-441f-88b5-51da26e2968d admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:38.979472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326a370-7598-441f-88b5-51da26e2968d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:38.988554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326a370-7598-441f-88b5-51da26e2968d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:39.040874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 860/1737] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:38 2022] POST /identity/v3/users => generated 289 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:39.044499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326a370-7598-441f-88b5-51da26e2968d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:39.052325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 878/1738] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:39.057765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482d82c-b0a7-4c1c-af93-f10928331fbe None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:39.075374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326a370-7598-441f-88b5-51da26e2968d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:39.097104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8012e9-7f1f-462f-af7c-b13965d8bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:39.101933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482d82c-b0a7-4c1c-af93-f10928331fbe None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:39.104164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8012e9-7f1f-462f-af7c-b13965d8bfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:39.104554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8012e9-7f1f-462f-af7c-b13965d8bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:39.104831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8012e9-7f1f-462f-af7c-b13965d8bfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:39.106089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8012e9-7f1f-462f-af7c-b13965d8bfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:39.109083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8012e9-7f1f-462f-af7c-b13965d8bfe1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:39.122597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b38931-e88c-4df2-a12c-6151213ea760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:39.126165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b38931-e88c-4df2-a12c-6151213ea760 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:39.126677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b38931-e88c-4df2-a12c-6151213ea760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:39.127090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b38931-e88c-4df2-a12c-6151213ea760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:39.127921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b38931-e88c-4df2-a12c-6151213ea760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:39.131356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b38931-e88c-4df2-a12c-6151213ea760 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:39.139476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 861/1739] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:39.149263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8012e9-7f1f-462f-af7c-b13965d8bfe1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:39.161024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:39.172619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8012e9-7f1f-462f-af7c-b13965d8bfe1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:39.190978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657aaf8-e12b-452a-b826-89657d1f8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:39.191671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:39.192409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657aaf8-e12b-452a-b826-89657d1f8e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:39.194335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657aaf8-e12b-452a-b826-89657d1f8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:39.196748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657aaf8-e12b-452a-b826-89657d1f8e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:39.198716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657aaf8-e12b-452a-b826-89657d1f8e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:39.214231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657aaf8-e12b-452a-b826-89657d1f8e1f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:39.246663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 879/1740] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:39 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:39.262606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b38931-e88c-4df2-a12c-6151213ea760 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:39.284061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 862/1741] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:32:39.291057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657aaf8-e12b-452a-b826-89657d1f8e1f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:39.340723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657aaf8-e12b-452a-b826-89657d1f8e1f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:39.501385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:39.509959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:39.509959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:39.509959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] PATH_INFO: `/v3/projects/2859242e79204e60a2f91a7f18842a33/users/11875d73b27c426ea55c4f18806c6a2a/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:39.533938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b38931-e88c-4df2-a12c-6151213ea760 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:39.540479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2859242e79204e60a2f91a7f18842a33, user_id=11875d73b27c426ea55c4f18806c6a2a, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:39.544297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:39.556246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db58d6d-ecac-4787-adef-a580333d57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:39.557093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58d6d-ecac-4787-adef-a580333d57dd admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:39.557468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58d6d-ecac-4787-adef-a580333d57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:39.558367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58d6d-ecac-4787-adef-a580333d57dd admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:39.559575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db58d6d-ecac-4787-adef-a580333d57dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:39.566220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db58d6d-ecac-4787-adef-a580333d57dd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:39.580673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 863/1742] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:39 2022] PUT /identity/v3/projects/2859242e79204e60a2f91a7f18842a33/users/11875d73b27c426ea55c4f18806c6a2a/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:39.590172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:39.593019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:39.653310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 880/1743] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:39 2022] POST /identity/v3/users => generated 292 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:39.655771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61fe1-c128-4b01-b92a-2c9dd493dc9e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:39.659825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61fe1-c128-4b01-b92a-2c9dd493dc9e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:39.661308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c61fe1-c128-4b01-b92a-2c9dd493dc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:39.765753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b2177-c0d0-4fec-b354-95aace5a3011 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:39.774306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-89c61fe1-c128-4b01-b92a-2c9dd493dc9e None None] MFA Rules not processed for user `11875d73b27c426ea55c4f18806c6a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:39.775312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:39.776797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:39.777190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:39.777349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-89c61fe1-c128-4b01-b92a-2c9dd493dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:39.777671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] PATH_INFO: `/v3/projects/637a26f80d934f028383112a6831c683` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:39.780268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] RBAC: Authorizing `identity:delete_project(project_id=637a26f80d934f028383112a6831c683)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:39.782388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:39.907519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637a26f80d934f028383112a6831c683', 'request_id': 'req-46630a9a-1444-4682-86da-d5e5092c597a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:39.924337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637a26f80d934f028383112a6831c683', 'request_id': 'req-46630a9a-1444-4682-86da-d5e5092c597a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:39.940780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 881/1744] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:39.942029 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c61fe1-c128-4b01-b92a-2c9dd493dc9e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:39.943266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637a26f80d934f028383112a6831c683', 'request_id': 'req-46630a9a-1444-4682-86da-d5e5092c597a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:39.965342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c61fe1-c128-4b01-b92a-2c9dd493dc9e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:39.990042 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] The token cache is being invalidate because project 637a26f80d934f028383112a6831c683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:39.997671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:39.999362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:40.002334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 864/1745] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:39 2022] DELETE /identity/v3/projects/637a26f80d934f028383112a6831c683 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:40.004461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:40.006529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:40.038377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:40.129711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:40.130684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:40.131204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:40.131715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:40.132764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:40.138084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:40.179276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 882/1746] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:40.180535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:40.184816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:40.220317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:40.229354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56743e4e-0327-49d7-99ec-da0284e98833 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:40.243002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46630a9a-1444-4682-86da-d5e5092c597a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:40.254919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:40.264962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:40.266475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:40.266475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:40.266475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:40.267140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:40.269542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:40.270032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:40.270483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] PATH_INFO: `/v3/users/7e45d0e26c5643ddb0faf994997684bf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:40.271709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:40.272312 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e45d0e26c5643ddb0faf994997684bf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:40.274720 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:40.350915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 865/1747] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:40 2022] POST /identity/v3/projects => generated 377 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:40.352093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:40.355440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:40.398710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e45d0e26c5643ddb0faf994997684bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:40.421815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e45d0e26c5643ddb0faf994997684bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:40.439104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e45d0e26c5643ddb0faf994997684bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:40.440268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e45d0e26c5643ddb0faf994997684bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:40.441824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e45d0e26c5643ddb0faf994997684bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:40.506801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d7d5-ddf0-4c2e-b4b9-c18423bca7d0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:40.507649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 883/1748] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:40 2022] DELETE /identity/v3/users/7e45d0e26c5643ddb0faf994997684bf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:40.509885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:40.514117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:40.606673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:40.607403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:40.607819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:40.608109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] PATH_INFO: `/v3/projects/7d019d8fe5cc48b289d64a1aed4495eb/users/97714b37fcc543b8b7b3ef02bb8783c3/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:40.646413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993168d-7e39-48d9-af83-8c28068819c1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:40.650783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d019d8fe5cc48b289d64a1aed4495eb, user_id=97714b37fcc543b8b7b3ef02bb8783c3, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:40.653581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506acae-07e6-44b1-9370-3219b5b63d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:40.654610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506acae-07e6-44b1-9370-3219b5b63d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:40.655147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506acae-07e6-44b1-9370-3219b5b63d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:40.655737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506acae-07e6-44b1-9370-3219b5b63d7c admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:40.656703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506acae-07e6-44b1-9370-3219b5b63d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:40.659818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:40.662540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506acae-07e6-44b1-9370-3219b5b63d7c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:40.696794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 866/1749] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:40 2022] PUT /identity/v3/projects/7d019d8fe5cc48b289d64a1aed4495eb/users/97714b37fcc543b8b7b3ef02bb8783c3/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:40.698313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 884/1750] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:40 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:40.702936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:40.703722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506acae-07e6-44b1-9370-3219b5b63d7c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:40.710267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:40.742184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506acae-07e6-44b1-9370-3219b5b63d7c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:40.774846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:40.898257 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e79696-9c50-4e30-a276-f3a5252e8454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:40.899563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79696-9c50-4e30-a276-f3a5252e8454 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:40.900601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79696-9c50-4e30-a276-f3a5252e8454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:40.901403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79696-9c50-4e30-a276-f3a5252e8454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:40.903257 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79696-9c50-4e30-a276-f3a5252e8454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:40.906839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79696-9c50-4e30-a276-f3a5252e8454 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:40.921538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf95ed-1d0f-4374-b2af-4f71ae9ac8ca admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:40.932566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 885/1751] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:40.935051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e79696-9c50-4e30-a276-f3a5252e8454 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:40.942238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044ad45-a568-4c9c-a1f4-714335db072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:40.942932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:40.944052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ad45-a568-4c9c-a1f4-714335db072f admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:40.944483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ad45-a568-4c9c-a1f4-714335db072f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:40.945773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ad45-a568-4c9c-a1f4-714335db072f admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:40.947360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044ad45-a568-4c9c-a1f4-714335db072f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:40.950817 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e79696-9c50-4e30-a276-f3a5252e8454 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:40.950943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044ad45-a568-4c9c-a1f4-714335db072f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:40.984075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 867/1752] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:40.986043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044ad45-a568-4c9c-a1f4-714335db072f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:40.993917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f124c-8734-484c-ac30-44290408328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:40.995140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f124c-8734-484c-ac30-44290408328b admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:40.997220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f124c-8734-484c-ac30-44290408328b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:40.997706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f124c-8734-484c-ac30-44290408328b admin admin] PATH_INFO: `/v3/projects/896ea0987e774b51abd7b990f38ae241/users/49d7ee2b74a54077ad085d76f294f8f5/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:41.039371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044ad45-a568-4c9c-a1f4-714335db072f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:41.061245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c91bcb-b724-410c-8793-11d1954564dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:41.065245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91bcb-b724-410c-8793-11d1954564dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:41.068155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91bcb-b724-410c-8793-11d1954564dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:41.068973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c91bcb-b724-410c-8793-11d1954564dd admin admin] PATH_INFO: `/v3/projects/7d019d8fe5cc48b289d64a1aed4495eb/users/97714b37fcc543b8b7b3ef02bb8783c3/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:41.075912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c91bcb-b724-410c-8793-11d1954564dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d019d8fe5cc48b289d64a1aed4495eb, user_id=97714b37fcc543b8b7b3ef02bb8783c3, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:41.086950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c91bcb-b724-410c-8793-11d1954564dd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:41.096772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f124c-8734-484c-ac30-44290408328b admin admin] RBAC: Authorizing `identity:create_grant(project_id=896ea0987e774b51abd7b990f38ae241, user_id=49d7ee2b74a54077ad085d76f294f8f5, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:41.107961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f124c-8734-484c-ac30-44290408328b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:41.141914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 886/1753] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:40 2022] PUT /identity/v3/projects/896ea0987e774b51abd7b990f38ae241/users/49d7ee2b74a54077ad085d76f294f8f5/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:41.148650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f124c-8734-484c-ac30-44290408328b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:41.186761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 868/1754] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:40 2022] PUT /identity/v3/projects/7d019d8fe5cc48b289d64a1aed4495eb/users/97714b37fcc543b8b7b3ef02bb8783c3/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:32:41.197414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdd981-7c4a-4179-be8f-426cdbb3f446 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:41.197710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdd981-7c4a-4179-be8f-426cdbb3f446 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:41.197990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdd981-7c4a-4179-be8f-426cdbb3f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:41.319112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-01bdd981-7c4a-4179-be8f-426cdbb3f446 None None] MFA Rules not processed for user `97714b37fcc543b8b7b3ef02bb8783c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:41.320316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-01bdd981-7c4a-4179-be8f-426cdbb3f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:41.402732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f124c-8734-484c-ac30-44290408328b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:41.417736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953148cc-bc1f-401a-b995-58fa2bee30d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:41.417736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953148cc-bc1f-401a-b995-58fa2bee30d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:41.417736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953148cc-bc1f-401a-b995-58fa2bee30d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:41.418280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953148cc-bc1f-401a-b995-58fa2bee30d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:41.418520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953148cc-bc1f-401a-b995-58fa2bee30d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:41.422597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953148cc-bc1f-401a-b995-58fa2bee30d2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:41.459885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 887/1755] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:32:41.462843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953148cc-bc1f-401a-b995-58fa2bee30d2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:41.500434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953148cc-bc1f-401a-b995-58fa2bee30d2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:41.512208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:41.521983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:41.522693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:41.522898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] PATH_INFO: `/v3/projects/896ea0987e774b51abd7b990f38ae241/users/49d7ee2b74a54077ad085d76f294f8f5/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:41.534641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=896ea0987e774b51abd7b990f38ae241, user_id=49d7ee2b74a54077ad085d76f294f8f5, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:41.544460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 869/1756] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:41.544460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdd981-7c4a-4179-be8f-426cdbb3f446 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:41.546079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-01bdd981-7c4a-4179-be8f-426cdbb3f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:41.562902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:41.588570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdd981-7c4a-4179-be8f-426cdbb3f446 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:41.613252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:41.614333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:41.614941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:41.615239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] PATH_INFO: `/v3/projects/17c3f7d40153409387d92b8d1c104c98` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:41.621128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 888/1757] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:41 2022] PUT /identity/v3/projects/896ea0987e774b51abd7b990f38ae241/users/49d7ee2b74a54077ad085d76f294f8f5/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:41.622453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:41.627351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c3f7d40153409387d92b8d1c104c98)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:41.634760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:41.635502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:41.812644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c3f7d40153409387d92b8d1c104c98', 'request_id': 'req-f252202f-da05-463a-ac3c-6496684ac6d5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:41.828582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c3f7d40153409387d92b8d1c104c98', 'request_id': 'req-f252202f-da05-463a-ac3c-6496684ac6d5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:41.852303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c3f7d40153409387d92b8d1c104c98', 'request_id': 'req-f252202f-da05-463a-ac3c-6496684ac6d5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:41.874872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] The token cache is being invalidate because project 17c3f7d40153409387d92b8d1c104c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:41.875394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:41.877485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f252202f-da05-463a-ac3c-6496684ac6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:41.882173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 870/1758] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:41 2022] DELETE /identity/v3/projects/17c3f7d40153409387d92b8d1c104c98 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:41.884248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe313c-d32b-4e32-8694-087eeec2252d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:41.884695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe313c-d32b-4e32-8694-087eeec2252d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:41.885578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe313c-d32b-4e32-8694-087eeec2252d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:41.894033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5d8c-dec1-49f6-8a9e-c94d21a91a5a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:41.928919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:41.949462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9bbe313c-d32b-4e32-8694-087eeec2252d None None] MFA Rules not processed for user `49d7ee2b74a54077ad085d76f294f8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:41.952368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9bbe313c-d32b-4e32-8694-087eeec2252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:42.062116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:42.062991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:42.063275 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:42.063549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:42.070073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:42.161339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 871/1759] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:42.165713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf824-dcf4-481c-916f-b064a4051885 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:42.165713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf824-dcf4-481c-916f-b064a4051885 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:42.165713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf824-dcf4-481c-916f-b064a4051885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:42.170016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:42.229271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9efdf824-dcf4-481c-916f-b064a4051885 None None] MFA Rules not processed for user `452b906a5338428d8fc824ddff2093e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:42.233774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9efdf824-dcf4-481c-916f-b064a4051885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:42.288206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:42.290509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:42.310833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 889/1760] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:42.311813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:42.313622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:42.414048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 872/1761] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:42.419752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdf824-dcf4-481c-916f-b064a4051885 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:42.419752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9efdf824-dcf4-481c-916f-b064a4051885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:42.442649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdf824-dcf4-481c-916f-b064a4051885 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:42.451415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:42.452551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:42.452840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:42.453120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:42.460217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:42.695261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41bc60-dafa-47da-b382-24af05bc8bc3 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:42.696852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:42.698937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:42.736938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 873/1762] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:42.747974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:42.752728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:42.753322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:42.753832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:42.754316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] PATH_INFO: `/v3/users/4ea3ae419af744f49581ea3652580140` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:42.761880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:42.762511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea3ae419af744f49581ea3652580140)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:42.766293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:42.863877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d1d16-dfc5-48df-9a8b-3e15926346a7 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:42.883258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:42.884243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:42.884560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:42.884954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] PATH_INFO: `/v3/projects/aad06177ce05493daa9d4f45189719fe` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:42.889957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad06177ce05493daa9d4f45189719fe)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:42.902068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:42.949983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea3ae419af744f49581ea3652580140'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:42.983597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea3ae419af744f49581ea3652580140'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.013382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea3ae419af744f49581ea3652580140'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.016223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea3ae419af744f49581ea3652580140'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.017760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b5cd2fb4-b988-4ec4-aae9-80645169cd72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea3ae419af744f49581ea3652580140'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.046195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 890/1763] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:42 2022] DELETE /identity/v3/users/4ea3ae419af744f49581ea3652580140 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:43.047965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940160-78b4-4fd7-a2f1-dceab8acfc47 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:43.048929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940160-78b4-4fd7-a2f1-dceab8acfc47 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:43.049327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940160-78b4-4fd7-a2f1-dceab8acfc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:43.142480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:43.196158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ca940160-78b4-4fd7-a2f1-dceab8acfc47 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:43.198231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad06177ce05493daa9d4f45189719fe', 'request_id': 'req-aad558a3-181e-49ea-8989-8e00c57c27c4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.205072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ca940160-78b4-4fd7-a2f1-dceab8acfc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:43.213759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad06177ce05493daa9d4f45189719fe', 'request_id': 'req-aad558a3-181e-49ea-8989-8e00c57c27c4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.230959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad06177ce05493daa9d4f45189719fe', 'request_id': 'req-aad558a3-181e-49ea-8989-8e00c57c27c4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.292150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] The token cache is being invalidate because project aad06177ce05493daa9d4f45189719fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:43.292799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.299081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aad558a3-181e-49ea-8989-8e00c57c27c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:43.305469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 874/1764] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:42 2022] DELETE /identity/v3/projects/aad06177ce05493daa9d4f45189719fe => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:43.310111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223000-5e23-42e1-b48e-1acda1908a8c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:43.312800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223000-5e23-42e1-b48e-1acda1908a8c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:43.314191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223000-5e23-42e1-b48e-1acda1908a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:43.322775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:43.441021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b0223000-5e23-42e1-b48e-1acda1908a8c None None] MFA Rules not processed for user `e6abe049ae6a4b5db081fcc0e164075b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:43.449984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b0223000-5e23-42e1-b48e-1acda1908a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:43.553961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 891/1765] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:43.556179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e98a7e-a891-4161-b967-7761842399d3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:43.556755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e98a7e-a891-4161-b967-7761842399d3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:43.557913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e98a7e-a891-4161-b967-7761842399d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:43.698281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b5e98a7e-a891-4161-b967-7761842399d3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:43.699780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b5e98a7e-a891-4161-b967-7761842399d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:43.928330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 875/1766] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 622 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:43.933105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6fc5-803a-477e-8070-c2698f942311 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:43.933482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6fc5-803a-477e-8070-c2698f942311 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:43.935231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6fc5-803a-477e-8070-c2698f942311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:43.978368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 892/1767] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:43.979611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e98a7e-a891-4161-b967-7761842399d3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:43.982170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b5e98a7e-a891-4161-b967-7761842399d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:43.996822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-871c6fc5-803a-477e-8070-c2698f942311 None None] MFA Rules not processed for user `2c871cad6d394173b2b43fc89940f1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:44.000752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-871c6fc5-803a-477e-8070-c2698f942311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:44.212480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 876/1768] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:44.214461 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6045f-d8c3-49ea-9fad-51969c333791 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:44.217724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6045f-d8c3-49ea-9fad-51969c333791 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:44.218144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6045f-d8c3-49ea-9fad-51969c333791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:44.270334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a3c6045f-d8c3-49ea-9fad-51969c333791 None None] MFA Rules not processed for user `e6abe049ae6a4b5db081fcc0e164075b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:44.279808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a3c6045f-d8c3-49ea-9fad-51969c333791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:44.302082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 877/1769] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:44.303591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6045f-d8c3-49ea-9fad-51969c333791 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:44.304526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e98a7e-a891-4161-b967-7761842399d3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:44.308736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a3c6045f-d8c3-49ea-9fad-51969c333791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:44.320708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014244-8f5b-4e05-96a0-00ff7d8020d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:44.322862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014244-8f5b-4e05-96a0-00ff7d8020d2 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:44.323353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014244-8f5b-4e05-96a0-00ff7d8020d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:44.323821 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014244-8f5b-4e05-96a0-00ff7d8020d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:44.336964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6045f-d8c3-49ea-9fad-51969c333791 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:44.350795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:44.351185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff014244-8f5b-4e05-96a0-00ff7d8020d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:44.351726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:44.352148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:44.353441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] PATH_INFO: `/v3/users/ea6fca7a943b4f2388e1aae330d91a1c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:44.355067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff014244-8f5b-4e05-96a0-00ff7d8020d2 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:44.356665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6fca7a943b4f2388e1aae330d91a1c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:44.363665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:44.386117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 893/1770] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:32:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:32:44.389372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda45cf-fd03-472a-a50b-deff3bba46af None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:44.390190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda45cf-fd03-472a-a50b-deff3bba46af None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:44.390340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda45cf-fd03-472a-a50b-deff3bba46af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:44.429490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-aeda45cf-fd03-472a-a50b-deff3bba46af None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:44.431612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-aeda45cf-fd03-472a-a50b-deff3bba46af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:44.454689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 894/1771] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:44.458164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda45cf-fd03-472a-a50b-deff3bba46af None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:44.459383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:44.465900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-aeda45cf-fd03-472a-a50b-deff3bba46af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:44.495284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6fca7a943b4f2388e1aae330d91a1c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:44.533936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6fca7a943b4f2388e1aae330d91a1c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:44.536022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6fca7a943b4f2388e1aae330d91a1c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:44.538322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6fca7a943b4f2388e1aae330d91a1c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:44.561429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:44.578281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6fca7a943b4f2388e1aae330d91a1c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:44.651356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 878/1772] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:44 2022] DELETE /identity/v3/users/ea6fca7a943b4f2388e1aae330d91a1c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:44.652681 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:44.657399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:44.774433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda45cf-fd03-472a-a50b-deff3bba46af None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:44.931235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde07b-64a8-40ee-88e7-a500f7bd9ed7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:44.965350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb921a-7435-489b-b2bf-91785a99e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:44.974882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb921a-7435-489b-b2bf-91785a99e5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:44.975314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb921a-7435-489b-b2bf-91785a99e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:44.975852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb921a-7435-489b-b2bf-91785a99e5f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:44.976751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb921a-7435-489b-b2bf-91785a99e5f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:44.977164 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb921a-7435-489b-b2bf-91785a99e5f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:44.983210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:44.983462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb921a-7435-489b-b2bf-91785a99e5f8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:44.988793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:44.990896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:44.994381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:45.002372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:45.018213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 879/1773] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:45.020087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8436d-5ab7-43f9-8226-019dd9b1507f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:45.023115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8436d-5ab7-43f9-8226-019dd9b1507f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:45.023749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8436d-5ab7-43f9-8226-019dd9b1507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:45.119777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bac8436d-5ab7-43f9-8226-019dd9b1507f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:45.127859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bac8436d-5ab7-43f9-8226-019dd9b1507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:45.167521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 880/1774] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:45.176344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8436d-5ab7-43f9-8226-019dd9b1507f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:45.210971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8436d-5ab7-43f9-8226-019dd9b1507f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:45.233114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:45.237721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:45.238238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:45.238971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:45.241521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:45.246940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:45.281451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:45.289047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:45.326794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 881/1775] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:45 2022] POST /identity/v3/projects => generated 409 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:45.329079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:45.333350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 895/1776] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 878 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:45.333607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:45.348981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:45.377011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8d878-3ae5-45ed-a456-d2423bb41d49 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:45.493107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:45.516756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:45.516756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:45.519308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:45.519693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:45.520411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:45.526544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:45.548194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcbb64-58ef-4598-b336-7e20967ec8fa admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:45.569918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:45.569918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:45.569918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:45.569918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:45.584100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:45.585911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:45.596329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 896/1777] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:45 2022] POST /identity/v3/users => generated 305 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:45.605795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:45.625507 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 882/1778] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:45.626650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:45.628670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:45.630539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:45.668222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:45.839333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae70229-ea7a-4b25-b670-aff50e76f5ec service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:45.851581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f41d9-446b-4818-b058-0f5c5846615b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:45.871993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:45.873274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:45.874273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:45.874712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:45.875367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:45.878854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:45.879189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:45.879439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:45.886202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:45.886504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:46.102195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:46.103751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:46.120375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:46.129007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:46.154556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 897/1779] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:46.155803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:46.189538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 883/1780] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:46.191899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:46.202580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:46.236642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fdd1f-4ed9-48ab-8dd1-e0f246c2eebb service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:46.265303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00c815-8c27-44f7-b285-e3c93ebbe1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:46.266313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c815-8c27-44f7-b285-e3c93ebbe1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:46.266649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c815-8c27-44f7-b285-e3c93ebbe1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:46.266967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c815-8c27-44f7-b285-e3c93ebbe1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:46.267513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00c815-8c27-44f7-b285-e3c93ebbe1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:46.270634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00c815-8c27-44f7-b285-e3c93ebbe1b1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:46.303115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9476a-767e-45a6-a8eb-37bcff3351ab service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:46.322761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 898/1781] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:46.332787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00c815-8c27-44f7-b285-e3c93ebbe1b1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:46.333850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:46.334522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:46.334813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:46.335060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] PATH_INFO: `/v3/projects/9edd43111c844be5a01ecbe4708af299` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:46.351101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edd43111c844be5a01ecbe4708af299)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:46.353436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:46.378051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00c815-8c27-44f7-b285-e3c93ebbe1b1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:46.404411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a5abe-f709-4c98-8d5e-49539dfa8207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:46.405111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a5abe-f709-4c98-8d5e-49539dfa8207 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:46.405418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a5abe-f709-4c98-8d5e-49539dfa8207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:46.405667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a5abe-f709-4c98-8d5e-49539dfa8207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:46.409764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a5abe-f709-4c98-8d5e-49539dfa8207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:46.419898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a5abe-f709-4c98-8d5e-49539dfa8207 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:46.461509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 899/1782] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:46.465248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a5abe-f709-4c98-8d5e-49539dfa8207 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:46.499223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a5abe-f709-4c98-8d5e-49539dfa8207 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:46.581907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edd43111c844be5a01ecbe4708af299', 'request_id': 'req-b84701fe-0d5c-4001-ad3e-91bf7986fb93'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:46.650001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edd43111c844be5a01ecbe4708af299', 'request_id': 'req-b84701fe-0d5c-4001-ad3e-91bf7986fb93'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:46.693783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edd43111c844be5a01ecbe4708af299', 'request_id': 'req-b84701fe-0d5c-4001-ad3e-91bf7986fb93'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:46.810324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] The token cache is being invalidate because project 9edd43111c844be5a01ecbe4708af299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:46.810805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:46.822445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b84701fe-0d5c-4001-ad3e-91bf7986fb93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:46.833412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 884/1783] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:46 2022] DELETE /identity/v3/projects/9edd43111c844be5a01ecbe4708af299 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:46.842544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd906d1d-d06d-420c-b809-3828e682ca3e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:46.843659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd906d1d-d06d-420c-b809-3828e682ca3e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:46.844167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd906d1d-d06d-420c-b809-3828e682ca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:46.872006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e2c91-efc3-4f9e-8049-224e8e7079b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:46.873047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2c91-efc3-4f9e-8049-224e8e7079b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:46.875378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2c91-efc3-4f9e-8049-224e8e7079b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:46.875693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2c91-efc3-4f9e-8049-224e8e7079b1 admin admin] PATH_INFO: `/v3/projects/fe1f853421ba46a28c3bcf639f21755b/users/35ccf447357546c6b88c283921b4fc06/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:46.941578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e2c91-efc3-4f9e-8049-224e8e7079b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1f853421ba46a28c3bcf639f21755b, user_id=35ccf447357546c6b88c283921b4fc06, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:46.956431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e2c91-efc3-4f9e-8049-224e8e7079b1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:46.977710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cd906d1d-d06d-420c-b809-3828e682ca3e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:46.981049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cd906d1d-d06d-420c-b809-3828e682ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:47.033094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 900/1784] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:46 2022] PUT /identity/v3/projects/fe1f853421ba46a28c3bcf639f21755b/users/35ccf447357546c6b88c283921b4fc06/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:47.034878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17476-35a3-401e-a32d-217114d50411 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:47.035049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17476-35a3-401e-a32d-217114d50411 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:47.035330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17476-35a3-401e-a32d-217114d50411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:47.076648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:47.172167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f9f17476-35a3-401e-a32d-217114d50411 None None] MFA Rules not processed for user `35ccf447357546c6b88c283921b4fc06`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:47.173126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:47.173974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f9f17476-35a3-401e-a32d-217114d50411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:47.371973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 885/1785] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:47.386990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c3fdc-9a30-4c7c-a2b5-f53828907dba None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:47.389115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c3fdc-9a30-4c7c-a2b5-f53828907dba None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:47.390437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c3fdc-9a30-4c7c-a2b5-f53828907dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:47.555676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 901/1786] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:47 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:47.569771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f17476-35a3-401e-a32d-217114d50411 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:47.574452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-870c3fdc-9a30-4c7c-a2b5-f53828907dba None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:47.587110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-870c3fdc-9a30-4c7c-a2b5-f53828907dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:47.589014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f9f17476-35a3-401e-a32d-217114d50411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:47.690263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f17476-35a3-401e-a32d-217114d50411 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:47.691457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 886/1787] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:47.700104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c3fdc-9a30-4c7c-a2b5-f53828907dba None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:47.724782 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8096-e900-4aa6-9ef7-bc8f0ec527b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:47.732182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8096-e900-4aa6-9ef7-bc8f0ec527b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:47.733056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8096-e900-4aa6-9ef7-bc8f0ec527b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:47.733716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8096-e900-4aa6-9ef7-bc8f0ec527b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:47.735349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d8096-e900-4aa6-9ef7-bc8f0ec527b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:47.745200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d8096-e900-4aa6-9ef7-bc8f0ec527b5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:47.775836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c3fdc-9a30-4c7c-a2b5-f53828907dba None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:47.873203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ef60b-3b9a-4374-b77a-62b65bf89745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:47.875537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef60b-3b9a-4374-b77a-62b65bf89745 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:47.881572 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef60b-3b9a-4374-b77a-62b65bf89745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:47.887947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef60b-3b9a-4374-b77a-62b65bf89745 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:47.897681 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef60b-3b9a-4374-b77a-62b65bf89745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:47.899811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef60b-3b9a-4374-b77a-62b65bf89745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:47.925511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef60b-3b9a-4374-b77a-62b65bf89745 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:48.056881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 887/1788] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:48.058265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c0d8-da82-4a14-809c-0c6cfc91808f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:48.058745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c0d8-da82-4a14-809c-0c6cfc91808f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:48.059209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c0d8-da82-4a14-809c-0c6cfc91808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:48.111494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 902/1789] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:47 2022] POST /identity/v3/projects => generated 407 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:48.136891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8096-e900-4aa6-9ef7-bc8f0ec527b5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:48.213047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4721c0d8-da82-4a14-809c-0c6cfc91808f None None] MFA Rules not processed for user `b310f17f81e040ac80dc1b9de52026f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:48.215192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4721c0d8-da82-4a14-809c-0c6cfc91808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:48.576439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 888/1790] 10.222.0.70 () {58 vars in 1015 bytes} [Tue Sep 13 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:48.597755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8096-e900-4aa6-9ef7-bc8f0ec527b5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:48.599492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721c0d8-da82-4a14-809c-0c6cfc91808f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:48.617371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27b1f0-0212-45ae-951a-fe0993f116c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:48.619070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27b1f0-0212-45ae-951a-fe0993f116c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:48.619732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27b1f0-0212-45ae-951a-fe0993f116c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:48.620786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27b1f0-0212-45ae-951a-fe0993f116c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:48.622210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27b1f0-0212-45ae-951a-fe0993f116c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:48.627164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27b1f0-0212-45ae-951a-fe0993f116c5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:48.698498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721c0d8-da82-4a14-809c-0c6cfc91808f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:48.719022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 903/1791] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:48 2022] POST /identity/v3/projects => generated 355 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:48.726249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27b1f0-0212-45ae-951a-fe0993f116c5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:48.756603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc7558-6575-4afa-ace4-d38eaaf09962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:48.758967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc7558-6575-4afa-ace4-d38eaaf09962 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:48.761561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc7558-6575-4afa-ace4-d38eaaf09962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:48.766720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc7558-6575-4afa-ace4-d38eaaf09962 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:48.770093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc7558-6575-4afa-ace4-d38eaaf09962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:48.781686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc7558-6575-4afa-ace4-d38eaaf09962 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:48.916682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 889/1792] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:48 2022] POST /identity/v3/users => generated 310 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:48.923492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096666f-29ca-43e1-8983-bf402c9cd2fd None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:48.924230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096666f-29ca-43e1-8983-bf402c9cd2fd None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:48.925975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096666f-29ca-43e1-8983-bf402c9cd2fd None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:48.947731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 890/1793] 10.222.0.55 () {54 vars in 912 bytes} [Tue Sep 13 12:32:48 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:32:48.956688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096666f-29ca-43e1-8983-bf402c9cd2fd None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:49.122635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:49.147166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27b1f0-0212-45ae-951a-fe0993f116c5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:49.165115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:49.165834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:49.166111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:49.166384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:49.167048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:49.170296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:49.242985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096666f-29ca-43e1-8983-bf402c9cd2fd None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:49.258814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424859e-581a-4445-b6b8-0d7d1264455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:49.258814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424859e-581a-4445-b6b8-0d7d1264455b admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:49.258814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424859e-581a-4445-b6b8-0d7d1264455b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:49.258814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424859e-581a-4445-b6b8-0d7d1264455b admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:49.259145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424859e-581a-4445-b6b8-0d7d1264455b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:49.262209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424859e-581a-4445-b6b8-0d7d1264455b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:49.291166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 891/1794] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:49.293249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96addfc-656c-45dc-a2cd-0a082c4c6b4a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:49.295960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96addfc-656c-45dc-a2cd-0a082c4c6b4a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:49.296553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96addfc-656c-45dc-a2cd-0a082c4c6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:49.335669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 904/1795] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:48 2022] POST /identity/v3/users => generated 278 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:49.345598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:49.356209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:49.367437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f96addfc-656c-45dc-a2cd-0a082c4c6b4a None None] MFA Rules not processed for user `b310f17f81e040ac80dc1b9de52026f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:49.369926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f96addfc-656c-45dc-a2cd-0a082c4c6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:49.602525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:49.650486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 892/1796] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:32:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:49.652066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96addfc-656c-45dc-a2cd-0a082c4c6b4a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:49.658561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f96addfc-656c-45dc-a2cd-0a082c4c6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:49.742025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faf9cd-5aaf-4a75-baaf-1a6f464f8377 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:49.758195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9e95-8a32-4c12-8f98-cc8af31eca8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:49.759966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9e95-8a32-4c12-8f98-cc8af31eca8b service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:49.760632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9e95-8a32-4c12-8f98-cc8af31eca8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:49.762827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9e95-8a32-4c12-8f98-cc8af31eca8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:49.798885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad9e95-8a32-4c12-8f98-cc8af31eca8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:49.802142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad9e95-8a32-4c12-8f98-cc8af31eca8b service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:49.848970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 905/1797] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:49.850783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9e95-8a32-4c12-8f98-cc8af31eca8b service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:49.867035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9e95-8a32-4c12-8f98-cc8af31eca8b service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:49.895833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c66ca-7337-414b-92f0-cd3c9693c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:49.896755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c66ca-7337-414b-92f0-cd3c9693c239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:49.897176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c66ca-7337-414b-92f0-cd3c9693c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:49.897552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c66ca-7337-414b-92f0-cd3c9693c239 admin admin] PATH_INFO: `/v3/projects/40b478aa4c334a4484aefb4ba6f30ff6/users/2399b8e81dfc488291edb552e1f1c54b/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:49.912835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96addfc-656c-45dc-a2cd-0a082c4c6b4a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:49.927969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:49.928954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:49.929413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:49.929840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:49.935928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:49.962729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c66ca-7337-414b-92f0-cd3c9693c239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b478aa4c334a4484aefb4ba6f30ff6, user_id=2399b8e81dfc488291edb552e1f1c54b, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:49.973644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c66ca-7337-414b-92f0-cd3c9693c239 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:50.049583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 906/1798] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:49 2022] PUT /identity/v3/projects/40b478aa4c334a4484aefb4ba6f30ff6/users/2399b8e81dfc488291edb552e1f1c54b/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:50.052285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c66ca-7337-414b-92f0-cd3c9693c239 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:50.271516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:50.283142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:50.310525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c66ca-7337-414b-92f0-cd3c9693c239 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:50.323269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:50.324473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:50.324938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:50.325406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:50.329318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:50.339397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:50.365430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 893/1799] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:50.367324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:50.373435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 907/1800] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:50.379827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:50.380081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:50.383754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:50.481464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0614ca-02da-45ac-9e44-6b2f3a801ae5 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:50.521506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:50.523216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:50.525173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:50.526205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] PATH_INFO: `/v3/projects/a834413b79394b0eb7ea84be794dfcef` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:50.528818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a834413b79394b0eb7ea84be794dfcef)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:50.533377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:50.609622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d93c43-c1ae-44eb-a50c-e7b97961d5b4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:50.632145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e80d4-f571-4987-a2fb-f993236eddc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:50.632897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e80d4-f571-4987-a2fb-f993236eddc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:50.633178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e80d4-f571-4987-a2fb-f993236eddc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:50.633455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e80d4-f571-4987-a2fb-f993236eddc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:50.675906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e80d4-f571-4987-a2fb-f993236eddc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:50.682096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e80d4-f571-4987-a2fb-f993236eddc2 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:50.722896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 908/1801] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:50.726510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e80d4-f571-4987-a2fb-f993236eddc2 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:50.757984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:50.784359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e80d4-f571-4987-a2fb-f993236eddc2 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:50.842469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a834413b79394b0eb7ea84be794dfcef', 'request_id': 'req-98325096-71ed-483e-b5f3-7b976a6950e2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:50.884850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a834413b79394b0eb7ea84be794dfcef', 'request_id': 'req-98325096-71ed-483e-b5f3-7b976a6950e2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:50.917802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a834413b79394b0eb7ea84be794dfcef', 'request_id': 'req-98325096-71ed-483e-b5f3-7b976a6950e2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:50.982835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] The token cache is being invalidate because project a834413b79394b0eb7ea84be794dfcef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:50.987030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:50.989617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:51.003889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 894/1802] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:50 2022] DELETE /identity/v3/projects/a834413b79394b0eb7ea84be794dfcef => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:51.005717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:51.019782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:51.169642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:51.170307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:51.170673 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:51.174227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:51.176833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:51.181621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:51.239875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 909/1803] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:51.244041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:51.252334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:51.291959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebd6e-60bf-447c-ba99-1325a88abe12 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:51.307771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:51.308552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:51.309703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:51.310078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] PATH_INFO: `/v3/users/97714b37fcc543b8b7b3ef02bb8783c3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:51.332250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97714b37fcc543b8b7b3ef02bb8783c3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:51.334411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:51.335121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:51.509267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97714b37fcc543b8b7b3ef02bb8783c3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:51.543235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97714b37fcc543b8b7b3ef02bb8783c3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:51.594054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98325096-71ed-483e-b5f3-7b976a6950e2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:51.619125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97714b37fcc543b8b7b3ef02bb8783c3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:51.620241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97714b37fcc543b8b7b3ef02bb8783c3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:51.622709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97714b37fcc543b8b7b3ef02bb8783c3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:51.633543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:51.637107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:51.637411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:51.641162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:51.654290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:51.658608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:51.677264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 910/1804] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:51 2022] DELETE /identity/v3/users/97714b37fcc543b8b7b3ef02bb8783c3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:51.677264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:51.682190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:51.724198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 895/1805] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 718 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:51.725286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:51.734187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:51.767946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38f5ca-59b5-4684-85bb-904d1aec006d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:51.961370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f129fa-9092-46bb-9f49-186213f93196 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:51.964557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05dfaf-6ff0-41bb-a000-929f7e50c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:51.968529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05dfaf-6ff0-41bb-a000-929f7e50c5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:51.968979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05dfaf-6ff0-41bb-a000-929f7e50c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:51.970932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05dfaf-6ff0-41bb-a000-929f7e50c5c6 admin admin] PATH_INFO: `/v3/projects/3f1baaeb5c024ad7970f0ba9c874cb5e/users/dac4ba8a818f412c95d224f8dacd60e2/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:51.974615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951f7cd-7c66-41cb-9d42-4da314a7dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:51.975345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f7cd-7c66-41cb-9d42-4da314a7dd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:51.975722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f7cd-7c66-41cb-9d42-4da314a7dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:51.976102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f7cd-7c66-41cb-9d42-4da314a7dd89 admin admin] PATH_INFO: `/v3/projects/40b478aa4c334a4484aefb4ba6f30ff6/users/2399b8e81dfc488291edb552e1f1c54b/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:51.983518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951f7cd-7c66-41cb-9d42-4da314a7dd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b478aa4c334a4484aefb4ba6f30ff6, user_id=2399b8e81dfc488291edb552e1f1c54b, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:51.989740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951f7cd-7c66-41cb-9d42-4da314a7dd89 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:52.027139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 911/1806] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:51 2022] PUT /identity/v3/projects/40b478aa4c334a4484aefb4ba6f30ff6/users/2399b8e81dfc488291edb552e1f1c54b/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:52.047555 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05dfaf-6ff0-41bb-a000-929f7e50c5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1baaeb5c024ad7970f0ba9c874cb5e, user_id=dac4ba8a818f412c95d224f8dacd60e2, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:52.051284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684a9b-05fb-4736-81fc-d78d9e36d1b2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:52.051575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684a9b-05fb-4736-81fc-d78d9e36d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:52.051846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05dfaf-6ff0-41bb-a000-929f7e50c5c6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:52.051953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684a9b-05fb-4736-81fc-d78d9e36d1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:52.064122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:52.091189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 896/1807] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:51 2022] PUT /identity/v3/projects/3f1baaeb5c024ad7970f0ba9c874cb5e/users/dac4ba8a818f412c95d224f8dacd60e2/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:52.110647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b987-e355-41ad-88a9-cb90205c343b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:52.111169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b987-e355-41ad-88a9-cb90205c343b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:52.111660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b987-e355-41ad-88a9-cb90205c343b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:52.152796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-18684a9b-05fb-4736-81fc-d78d9e36d1b2 None None] MFA Rules not processed for user `2399b8e81dfc488291edb552e1f1c54b`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:52.154091 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-18684a9b-05fb-4736-81fc-d78d9e36d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:52.262935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2655b987-e355-41ad-88a9-cb90205c343b None None] MFA Rules not processed for user `dac4ba8a818f412c95d224f8dacd60e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:52.265138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2655b987-e355-41ad-88a9-cb90205c343b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:52.356199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 912/1808] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:52 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:52.476003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18684a9b-05fb-4736-81fc-d78d9e36d1b2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:52.477687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-18684a9b-05fb-4736-81fc-d78d9e36d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:52.681688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18684a9b-05fb-4736-81fc-d78d9e36d1b2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:52.699692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 897/1809] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 591 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:52.701249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bebbb-6c1e-4756-a9e4-8da437ffe384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:52.701912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bebbb-6c1e-4756-a9e4-8da437ffe384 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:52.702199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bebbb-6c1e-4756-a9e4-8da437ffe384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:52.702453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bebbb-6c1e-4756-a9e4-8da437ffe384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:52.707107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b987-e355-41ad-88a9-cb90205c343b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:52.763533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bebbb-6c1e-4756-a9e4-8da437ffe384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:52.769023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bebbb-6c1e-4756-a9e4-8da437ffe384 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:52.816251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 913/1810] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:52 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:32:52.886905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:53.034408 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b987-e355-41ad-88a9-cb90205c343b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:53.064325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4fb79-0bb6-47e5-a449-1da43ce29c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:53.064897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4fb79-0bb6-47e5-a449-1da43ce29c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:53.065214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4fb79-0bb6-47e5-a449-1da43ce29c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:53.065603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4fb79-0bb6-47e5-a449-1da43ce29c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:53.066396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4fb79-0bb6-47e5-a449-1da43ce29c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:53.087058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4fb79-0bb6-47e5-a449-1da43ce29c7a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:53.188421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 898/1811] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:52 2022] POST /identity/v3/projects => generated 355 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:53.193877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bebbb-6c1e-4756-a9e4-8da437ffe384 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:53.219365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bebbb-6c1e-4756-a9e4-8da437ffe384 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:53.405417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541beec4-d654-480b-ad95-cb3cede4f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:53.406451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541beec4-d654-480b-ad95-cb3cede4f442 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:53.406451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541beec4-d654-480b-ad95-cb3cede4f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:53.406758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541beec4-d654-480b-ad95-cb3cede4f442 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:53.408765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541beec4-d654-480b-ad95-cb3cede4f442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:53.412027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541beec4-d654-480b-ad95-cb3cede4f442 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:53.471497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 914/1812] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:53 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:53.477511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4fb79-0bb6-47e5-a449-1da43ce29c7a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:53.492170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4fb79-0bb6-47e5-a449-1da43ce29c7a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:53.498767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c75c7-8801-451f-a5ca-1be3366de1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:53.499681 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c75c7-8801-451f-a5ca-1be3366de1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:53.500846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c75c7-8801-451f-a5ca-1be3366de1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:53.501334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c75c7-8801-451f-a5ca-1be3366de1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:53.502326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c75c7-8801-451f-a5ca-1be3366de1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:53.504500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c75c7-8801-451f-a5ca-1be3366de1cc admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:53.540653 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 899/1813] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:53.556661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541beec4-d654-480b-ad95-cb3cede4f442 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:53.597170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541beec4-d654-480b-ad95-cb3cede4f442 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:53.647703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:53.648939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:53.650018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:53.650689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] PATH_INFO: `/v3/projects/52d7ce1aa5f04526832bfc1f1726252d/users/a64d20f2441c40ab82aa0cf2d3abca2d/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:53.690991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d7ce1aa5f04526832bfc1f1726252d, user_id=a64d20f2441c40ab82aa0cf2d3abca2d, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:53.707998 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:53.727324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:53.746678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 915/1814] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:53 2022] PUT /identity/v3/projects/52d7ce1aa5f04526832bfc1f1726252d/users/a64d20f2441c40ab82aa0cf2d3abca2d/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:53.749574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c75c7-8801-451f-a5ca-1be3366de1cc admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:53.773464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c75c7-8801-451f-a5ca-1be3366de1cc admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:53.781269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:53.783580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:53.975310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d866c7a-ce40-4aa2-8ceb-e384a32719cc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:53.989057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:53.992858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:53.994698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:53.995421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:54.001068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:54.021962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14fa35-6dbf-457a-ab18-cdb8912e0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:54.022632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14fa35-6dbf-457a-ab18-cdb8912e0e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:54.022946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14fa35-6dbf-457a-ab18-cdb8912e0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:54.023385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14fa35-6dbf-457a-ab18-cdb8912e0e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:54.028054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14fa35-6dbf-457a-ab18-cdb8912e0e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:54.032288 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14fa35-6dbf-457a-ab18-cdb8912e0e03 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:54.066080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 900/1815] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:32:54.069383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f38c-0da1-4691-8db8-4bff18a074d7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:54.069593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f38c-0da1-4691-8db8-4bff18a074d7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:54.069804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f38c-0da1-4691-8db8-4bff18a074d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:54.115127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4915f38c-0da1-4691-8db8-4bff18a074d7 None None] MFA Rules not processed for user `e6abe049ae6a4b5db081fcc0e164075b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:54.118609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4915f38c-0da1-4691-8db8-4bff18a074d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:54.197376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:54.199229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:54.226476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 916/1816] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:53 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:54.227835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:54.257021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4513-1220-4274-a61b-038e29f787da service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:54.271947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b249-49ad-4fa3-bbf2-7cb6ed5c3c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:54.272680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b249-49ad-4fa3-bbf2-7cb6ed5c3c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:54.272990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b249-49ad-4fa3-bbf2-7cb6ed5c3c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:54.273253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b249-49ad-4fa3-bbf2-7cb6ed5c3c7f admin admin] PATH_INFO: `/v3/projects/52d7ce1aa5f04526832bfc1f1726252d/users/a64d20f2441c40ab82aa0cf2d3abca2d/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:54.277379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b249-49ad-4fa3-bbf2-7cb6ed5c3c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d7ce1aa5f04526832bfc1f1726252d, user_id=a64d20f2441c40ab82aa0cf2d3abca2d, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:54.280486 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b249-49ad-4fa3-bbf2-7cb6ed5c3c7f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:54.312277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 901/1817] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:54.324511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 917/1818] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:54 2022] PUT /identity/v3/projects/52d7ce1aa5f04526832bfc1f1726252d/users/a64d20f2441c40ab82aa0cf2d3abca2d/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:54.335925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66a87-9a4f-4127-9027-5545e34d9e1c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:54.336320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66a87-9a4f-4127-9027-5545e34d9e1c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:54.336582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66a87-9a4f-4127-9027-5545e34d9e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:54.446304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ecb66a87-9a4f-4127-9027-5545e34d9e1c None None] MFA Rules not processed for user `a64d20f2441c40ab82aa0cf2d3abca2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:54.448017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ecb66a87-9a4f-4127-9027-5545e34d9e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:54.660235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:54.840891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 902/1819] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:54.959614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b249-49ad-4fa3-bbf2-7cb6ed5c3c7f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:55.326615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b249-49ad-4fa3-bbf2-7cb6ed5c3c7f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:55.369716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:55.371133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:55.371947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:55.373630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665aa9-2e73-4fd5-95d6-76d6aceee917 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:55.374259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:55.374368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665aa9-2e73-4fd5-95d6-76d6aceee917 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:55.374899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665aa9-2e73-4fd5-95d6-76d6aceee917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:55.428562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a9665aa9-2e73-4fd5-95d6-76d6aceee917 None None] MFA Rules not processed for user `2c871cad6d394173b2b43fc89940f1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:55.430265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a9665aa9-2e73-4fd5-95d6-76d6aceee917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:55.479684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:55.509256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:55.613283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 918/1820] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:55.729319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 903/1821] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:32:55.882543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:55.884014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:56.122926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:56.135633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9665aa9-2e73-4fd5-95d6-76d6aceee917 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:56.143393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a9665aa9-2e73-4fd5-95d6-76d6aceee917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:56.207742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724dfea-b5c0-4343-a31a-50f31972e88a service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:56.220644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:56.223301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:56.223985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:56.225088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] PATH_INFO: `/v3/projects/7d019d8fe5cc48b289d64a1aed4495eb` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:56.229079 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d019d8fe5cc48b289d64a1aed4495eb)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:56.233553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:56.398244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d019d8fe5cc48b289d64a1aed4495eb', 'request_id': 'req-9ba6012b-c622-4b5b-974a-4364e88e45db'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:56.441142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d019d8fe5cc48b289d64a1aed4495eb', 'request_id': 'req-9ba6012b-c622-4b5b-974a-4364e88e45db'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:56.467649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d019d8fe5cc48b289d64a1aed4495eb', 'request_id': 'req-9ba6012b-c622-4b5b-974a-4364e88e45db'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:56.529013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] The token cache is being invalidate because project 7d019d8fe5cc48b289d64a1aed4495eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:32:56.531584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:56.532261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:56.549909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 919/1822] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:32:55 2022] DELETE /identity/v3/projects/7d019d8fe5cc48b289d64a1aed4495eb => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:56.563325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:56.567844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:56.586107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9665aa9-2e73-4fd5-95d6-76d6aceee917 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:56.917540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:56.918122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:56.918407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:56.918682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] PATH_INFO: `/v3/users/b5bcba78765a4402a6dc0fcf4961bd17` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:56.925581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5bcba78765a4402a6dc0fcf4961bd17)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:56.927677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:56.964669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6012b-c622-4b5b-974a-4364e88e45db admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:56.981478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec35210-d5c8-468f-8ce5-492d2df50886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:56.982959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35210-d5c8-468f-8ce5-492d2df50886 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:56.983770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35210-d5c8-468f-8ce5-492d2df50886 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:56.983770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35210-d5c8-468f-8ce5-492d2df50886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:56.992032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5ec35210-d5c8-468f-8ce5-492d2df50886 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:57.046209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:57.087516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5bcba78765a4402a6dc0fcf4961bd17'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:57.131791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5bcba78765a4402a6dc0fcf4961bd17'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:57.137017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5bcba78765a4402a6dc0fcf4961bd17'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:57.149455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5bcba78765a4402a6dc0fcf4961bd17'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:57.182123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-775eccd2-11a7-4044-b42e-0c2294664357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5bcba78765a4402a6dc0fcf4961bd17'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:32:57.252543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 904/1823] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:32:56 2022] DELETE /identity/v3/users/b5bcba78765a4402a6dc0fcf4961bd17 => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:57.259192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e89c2-ed30-44aa-ae1a-64ad32586b08 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:57.259367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e89c2-ed30-44aa-ae1a-64ad32586b08 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:57.267406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e89c2-ed30-44aa-ae1a-64ad32586b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:57.289352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec35210-d5c8-468f-8ce5-492d2df50886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:57.293141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec35210-d5c8-468f-8ce5-492d2df50886 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:57.329727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 920/1824] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:57.335490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab482ca-b464-42ce-8889-d73d7b60d4f5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:57.336884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab482ca-b464-42ce-8889-d73d7b60d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:57.337302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab482ca-b464-42ce-8889-d73d7b60d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:57.338448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-494e89c2-ed30-44aa-ae1a-64ad32586b08 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:57.343693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-494e89c2-ed30-44aa-ae1a-64ad32586b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:57.383855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dab482ca-b464-42ce-8889-d73d7b60d4f5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:57.385639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dab482ca-b464-42ce-8889-d73d7b60d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:57.480506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:57.618317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 905/1825] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:57.623145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13f92-341d-496b-9585-a60757e696b1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:57.623561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13f92-341d-496b-9585-a60757e696b1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:57.626563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13f92-341d-496b-9585-a60757e696b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:57.740549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-48f13f92-341d-496b-9585-a60757e696b1 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:57.740549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-48f13f92-341d-496b-9585-a60757e696b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:57.740974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 921/1826] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:57.743011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2edd6-dc78-4474-81f8-9606fe065c27 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:57.743508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2edd6-dc78-4474-81f8-9606fe065c27 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:57.744571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2edd6-dc78-4474-81f8-9606fe065c27 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:57.746969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 922/1827] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:32:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:32:57.771618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2edd6-dc78-4474-81f8-9606fe065c27 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:57.781250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-29c2edd6-dc78-4474-81f8-9606fe065c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:57.804746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 906/1828] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:57.809620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f13f92-341d-496b-9585-a60757e696b1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:57.843582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f13f92-341d-496b-9585-a60757e696b1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:57.864737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:57.865300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:57.865581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:57.865855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:57.866595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:32:57.866918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:57.897460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:57.954510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 907/1829] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:32:57.961563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:57.997570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ace76-a7a4-4807-bd2a-26f48d2b189d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:58.016116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b220b-7260-4ae4-a819-5117ddcb2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:58.018655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b220b-7260-4ae4-a819-5117ddcb2cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:58.018655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b220b-7260-4ae4-a819-5117ddcb2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:58.018655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b220b-7260-4ae4-a819-5117ddcb2cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:58.018655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b220b-7260-4ae4-a819-5117ddcb2cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:58.029766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b220b-7260-4ae4-a819-5117ddcb2cc0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:58.119796 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 908/1830] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:57 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:58.121929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3739fc8-77e2-4109-ae69-b018daaa3fe5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:58.122488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3739fc8-77e2-4109-ae69-b018daaa3fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:58.123103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3739fc8-77e2-4109-ae69-b018daaa3fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:58.189207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2edd6-dc78-4474-81f8-9606fe065c27 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:58.237493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f3739fc8-77e2-4109-ae69-b018daaa3fe5 None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:58.243154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f3739fc8-77e2-4109-ae69-b018daaa3fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:58.384300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a0b19-4d52-4195-9973-27d2e81dac39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:58.385668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0b19-4d52-4195-9973-27d2e81dac39 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:58.386089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0b19-4d52-4195-9973-27d2e81dac39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:58.386502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a0b19-4d52-4195-9973-27d2e81dac39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:58.498790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:58.576046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 909/1831] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:32:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:58.578240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3739fc8-77e2-4109-ae69-b018daaa3fe5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:58.579139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a0b19-4d52-4195-9973-27d2e81dac39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:58.580770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a0b19-4d52-4195-9973-27d2e81dac39 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:58.618260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 923/1832] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 847 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:32:58.642930 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3739fc8-77e2-4109-ae69-b018daaa3fe5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:58.667348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9254b87-890c-48e0-a88c-7aa01ecad78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:58.668926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9254b87-890c-48e0-a88c-7aa01ecad78a admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:58.669757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9254b87-890c-48e0-a88c-7aa01ecad78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:58.671478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9254b87-890c-48e0-a88c-7aa01ecad78a admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:58.672650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9254b87-890c-48e0-a88c-7aa01ecad78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:58.683112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9254b87-890c-48e0-a88c-7aa01ecad78a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:58.772122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 910/1833] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:32:58 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:32:58.776150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a0b19-4d52-4195-9973-27d2e81dac39 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:58.795528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a0b19-4d52-4195-9973-27d2e81dac39 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:58.839688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5935e3-c67e-46b8-aabc-f4ee9c26afc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:58.844624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5935e3-c67e-46b8-aabc-f4ee9c26afc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:58.845509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5935e3-c67e-46b8-aabc-f4ee9c26afc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:58.849170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5935e3-c67e-46b8-aabc-f4ee9c26afc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:58.851017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5935e3-c67e-46b8-aabc-f4ee9c26afc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:58.865492 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5935e3-c67e-46b8-aabc-f4ee9c26afc8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:58.904153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 924/1834] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:58.909768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9254b87-890c-48e0-a88c-7aa01ecad78a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:58.925604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9254b87-890c-48e0-a88c-7aa01ecad78a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:58.957755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c562612-6f02-47de-8c75-bb18383a3ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:58.958317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c562612-6f02-47de-8c75-bb18383a3ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:58.958606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c562612-6f02-47de-8c75-bb18383a3ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:58.958922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c562612-6f02-47de-8c75-bb18383a3ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:58.959760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c562612-6f02-47de-8c75-bb18383a3ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:58.961275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c562612-6f02-47de-8c75-bb18383a3ac5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:59.044182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 911/1835] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:32:59.050987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5935e3-c67e-46b8-aabc-f4ee9c26afc8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:59.086603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5935e3-c67e-46b8-aabc-f4ee9c26afc8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:59.098242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:59.099433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:59.100099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:59.100683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] PATH_INFO: `/v3/projects/a2969c45f302477fab40f28f3dc63f58/users/fe2774972702418092829d1aef896ceb/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:59.170202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2969c45f302477fab40f28f3dc63f58, user_id=fe2774972702418092829d1aef896ceb, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:59.191282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:32:59.232882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:32:59.255999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 925/1836] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:32:59 2022] PUT /identity/v3/projects/a2969c45f302477fab40f28f3dc63f58/users/fe2774972702418092829d1aef896ceb/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:32:59.270767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f0362-9076-4ee0-844a-b34d9fd6ed82 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:59.271377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f0362-9076-4ee0-844a-b34d9fd6ed82 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:59.271377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f0362-9076-4ee0-844a-b34d9fd6ed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:59.361618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a72f0362-9076-4ee0-844a-b34d9fd6ed82 None None] MFA Rules not processed for user `fe2774972702418092829d1aef896ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:32:59.363463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a72f0362-9076-4ee0-844a-b34d9fd6ed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:59.621614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:59.624918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:32:59.638326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 912/1837] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:32:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:32:59.644573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f0362-9076-4ee0-844a-b34d9fd6ed82 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:32:59.862737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f0362-9076-4ee0-844a-b34d9fd6ed82 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:32:59.882247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d7171-ba4a-464a-9090-cfddb75b7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:32:59.886201 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d7171-ba4a-464a-9090-cfddb75b7ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:32:59.886552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d7171-ba4a-464a-9090-cfddb75b7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:32:59.887065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d7171-ba4a-464a-9090-cfddb75b7ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:32:59.888216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d7171-ba4a-464a-9090-cfddb75b7ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:32:59.899373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d7171-ba4a-464a-9090-cfddb75b7ae6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:00.015936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 913/1838] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:32:59 2022] POST /identity/v3/projects => generated 387 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:00.017206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d7171-ba4a-464a-9090-cfddb75b7ae6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:00.090482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89f7c9-c163-41e1-b5c3-72bbbce30bc9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:00.188065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:00.230230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d7171-ba4a-464a-9090-cfddb75b7ae6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:00.241357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:00.247179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:00.249289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:00.251747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:00.251747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:00.257902 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:00.312443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 914/1839] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:00 2022] POST /identity/v3/users => generated 294 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:00.317347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:00.323000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:00.327065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68180590-75a5-422d-93f6-91b04a4ad774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:00.329274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68180590-75a5-422d-93f6-91b04a4ad774 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:00.335532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68180590-75a5-422d-93f6-91b04a4ad774 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:00.336947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68180590-75a5-422d-93f6-91b04a4ad774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:00.354790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25e0ad-751e-4c05-a912-f3f70444f27c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:00.386003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68180590-75a5-422d-93f6-91b04a4ad774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:00.389002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:00.390225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:00.390492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:00.390868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] PATH_INFO: `/v3/projects/d32acacd82434e3fba1522efaa3f0ba6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:00.392236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32acacd82434e3fba1522efaa3f0ba6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:00.394175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68180590-75a5-422d-93f6-91b04a4ad774 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:00.394367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:00.478331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 926/1840] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:32:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:33:00.479984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68180590-75a5-422d-93f6-91b04a4ad774 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:00.495941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68180590-75a5-422d-93f6-91b04a4ad774 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:00.522465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b142c-cf96-4fd9-80d4-474a257e71a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:00.526625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b142c-cf96-4fd9-80d4-474a257e71a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:00.527683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b142c-cf96-4fd9-80d4-474a257e71a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:00.527979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b142c-cf96-4fd9-80d4-474a257e71a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:00.529638 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b142c-cf96-4fd9-80d4-474a257e71a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:00.536982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b142c-cf96-4fd9-80d4-474a257e71a1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:00.561062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 927/1841] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:00.583182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32acacd82434e3fba1522efaa3f0ba6', 'request_id': 'req-26a39a53-2b46-48db-91af-3cdad2666554'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:00.588069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b142c-cf96-4fd9-80d4-474a257e71a1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:00.597191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32acacd82434e3fba1522efaa3f0ba6', 'request_id': 'req-26a39a53-2b46-48db-91af-3cdad2666554'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:00.621859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b142c-cf96-4fd9-80d4-474a257e71a1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:00.627985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32acacd82434e3fba1522efaa3f0ba6', 'request_id': 'req-26a39a53-2b46-48db-91af-3cdad2666554'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:00.650851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] The token cache is being invalidate because project d32acacd82434e3fba1522efaa3f0ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:00.651158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:00.654946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:00.655953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 915/1842] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:00 2022] DELETE /identity/v3/projects/d32acacd82434e3fba1522efaa3f0ba6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:00.662659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:00.667235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:00.913932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39a53-2b46-48db-91af-3cdad2666554 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:00.927733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:00.928853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:00.929374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:00.929901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] PATH_INFO: `/v3/users/11875d73b27c426ea55c4f18806c6a2a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:00.932794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11875d73b27c426ea55c4f18806c6a2a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:00.939071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:00.984915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:00.986882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:00.987418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:00.987911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:00.989199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:01.009475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:01.055253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 928/1843] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:01.061883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:01.067433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:01.125775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a110c2-f243-4f1c-9654-4979ad2c6df4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:01.130984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11875d73b27c426ea55c4f18806c6a2a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:01.142447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:01.148741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:01.149187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:01.149472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] PATH_INFO: `/v3/projects/24e385ae3a7840af88d4ebfaa2a672ce/users/fa3fe59cda844e6a8c20aa19bd7cb00c/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:01.165890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11875d73b27c426ea55c4f18806c6a2a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:01.165890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11875d73b27c426ea55c4f18806c6a2a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:01.165890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11875d73b27c426ea55c4f18806c6a2a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:01.175996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:01.190445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:01.202974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-47b3f7f2-2ad2-458c-b15b-672e17a5519c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11875d73b27c426ea55c4f18806c6a2a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:01.258527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 916/1844] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:00 2022] DELETE /identity/v3/users/11875d73b27c426ea55c4f18806c6a2a => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:01.305628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e385ae3a7840af88d4ebfaa2a672ce, user_id=fa3fe59cda844e6a8c20aa19bd7cb00c, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:01.310435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:01.400044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 929/1845] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:01 2022] PUT /identity/v3/projects/24e385ae3a7840af88d4ebfaa2a672ce/users/fa3fe59cda844e6a8c20aa19bd7cb00c/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:01.412955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f985e1-bb06-4daa-8f61-801cd747f059 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:01.414666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f985e1-bb06-4daa-8f61-801cd747f059 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:01.415707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f985e1-bb06-4daa-8f61-801cd747f059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:01.658463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f3f985e1-bb06-4daa-8f61-801cd747f059 None None] MFA Rules not processed for user `fa3fe59cda844e6a8c20aa19bd7cb00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:01.671849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f3f985e1-bb06-4daa-8f61-801cd747f059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:02.082847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 917/1846] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 672 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:02.087712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:02.092099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:02.483951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51c935-7639-4ba2-ae62-a8ed44919908 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:02.499134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc21d1-8278-48c7-82b0-13547f033074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:02.499134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc21d1-8278-48c7-82b0-13547f033074 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:02.499134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc21d1-8278-48c7-82b0-13547f033074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:02.499134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc21d1-8278-48c7-82b0-13547f033074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:02.499744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc21d1-8278-48c7-82b0-13547f033074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:02.500515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc21d1-8278-48c7-82b0-13547f033074 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:02.591556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 930/1847] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:02 2022] POST /identity/v3/projects => generated 385 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:02.592414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f985e1-bb06-4daa-8f61-801cd747f059 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:02.619060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f985e1-bb06-4daa-8f61-801cd747f059 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:02.817823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed62fad-75ac-4cb7-b052-0a81b4243591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:02.818538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed62fad-75ac-4cb7-b052-0a81b4243591 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:02.818993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed62fad-75ac-4cb7-b052-0a81b4243591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:02.819618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed62fad-75ac-4cb7-b052-0a81b4243591 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:02.820645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed62fad-75ac-4cb7-b052-0a81b4243591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:02.829595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed62fad-75ac-4cb7-b052-0a81b4243591 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:02.899400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 918/1848] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:02 2022] POST /identity/v3/users => generated 299 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:02.901007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc21d1-8278-48c7-82b0-13547f033074 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:02.918562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc21d1-8278-48c7-82b0-13547f033074 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:02.928577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6955f8a-51fd-4d28-802c-dcb610455451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:02.930825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955f8a-51fd-4d28-802c-dcb610455451 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:02.930825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955f8a-51fd-4d28-802c-dcb610455451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:02.930825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955f8a-51fd-4d28-802c-dcb610455451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:02.930825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6955f8a-51fd-4d28-802c-dcb610455451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:02.932489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6955f8a-51fd-4d28-802c-dcb610455451 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:02.955120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 931/1849] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:02.956192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed62fad-75ac-4cb7-b052-0a81b4243591 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:02.972505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed62fad-75ac-4cb7-b052-0a81b4243591 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:02.995668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:02.996585 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:02.996869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:02.997152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] PATH_INFO: `/v3/projects/d9d4ce9421ab412988bc3876fce1b827/users/d4e8e2ea2d004a61a7d020ebbfb934ed/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:03.059099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d4ce9421ab412988bc3876fce1b827, user_id=d4e8e2ea2d004a61a7d020ebbfb934ed, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:03.067755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:03.155230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 919/1850] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:02 2022] PUT /identity/v3/projects/d9d4ce9421ab412988bc3876fce1b827/users/d4e8e2ea2d004a61a7d020ebbfb934ed/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:03.157669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6955f8a-51fd-4d28-802c-dcb610455451 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:03.182678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6955f8a-51fd-4d28-802c-dcb610455451 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:03.212073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:03.218915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:03.503367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:03.657745 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:03.658896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:03.659331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:03.670411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:03.671698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:03.675306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:03.684377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714ecfa-67a1-4dc5-a020-33cccea872d8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:03.710353 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:03.710353 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:03.710353 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:03.710353 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] PATH_INFO: `/v3/projects/2859242e79204e60a2f91a7f18842a33` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:03.715370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2859242e79204e60a2f91a7f18842a33)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:03.717619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:03.739353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 932/1851] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 583 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:03.749912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:03.759932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:03.833011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec04d9-f8b6-4bfe-b411-64a0414b55e7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:03.841831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:03.844251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:03.848285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:03.849417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] PATH_INFO: `/v3/users/35ccf447357546c6b88c283921b4fc06` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:03.855794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ccf447357546c6b88c283921b4fc06)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:03.863172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:03.908454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2859242e79204e60a2f91a7f18842a33', 'request_id': 'req-e426d306-f182-4600-8338-d84353d4e14a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:03.945967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2859242e79204e60a2f91a7f18842a33', 'request_id': 'req-e426d306-f182-4600-8338-d84353d4e14a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:03.974640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2859242e79204e60a2f91a7f18842a33', 'request_id': 'req-e426d306-f182-4600-8338-d84353d4e14a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:04.025039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] The token cache is being invalidate because project 2859242e79204e60a2f91a7f18842a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:04.025407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:04.027656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:04.037588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 920/1852] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:03 2022] DELETE /identity/v3/projects/2859242e79204e60a2f91a7f18842a33 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:04.040738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:04.043448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:04.226848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ccf447357546c6b88c283921b4fc06'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:04.236245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:04.286223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ccf447357546c6b88c283921b4fc06'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:04.313036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ccf447357546c6b88c283921b4fc06'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:04.313682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ccf447357546c6b88c283921b4fc06'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:04.314314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ccf447357546c6b88c283921b4fc06'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:04.325889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426d306-f182-4600-8338-d84353d4e14a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:04.344208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35ec4e-eb68-400f-a56e-0de4913b5431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:04.345348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35ec4e-eb68-400f-a56e-0de4913b5431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:04.348524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35ec4e-eb68-400f-a56e-0de4913b5431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:04.349273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35ec4e-eb68-400f-a56e-0de4913b5431 admin admin] PATH_INFO: `/v3/projects/d9d4ce9421ab412988bc3876fce1b827/users/d4e8e2ea2d004a61a7d020ebbfb934ed/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:04.355679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35ec4e-eb68-400f-a56e-0de4913b5431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d4ce9421ab412988bc3876fce1b827, user_id=d4e8e2ea2d004a61a7d020ebbfb934ed, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:04.363567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 933/1853] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:03 2022] DELETE /identity/v3/users/35ccf447357546c6b88c283921b4fc06 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:04.364648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:04.371109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35ec4e-eb68-400f-a56e-0de4913b5431 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:04.383238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:04.407606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 921/1854] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:04 2022] PUT /identity/v3/projects/d9d4ce9421ab412988bc3876fce1b827/users/d4e8e2ea2d004a61a7d020ebbfb934ed/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:04.414576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399657-debd-41b4-bd3c-1fc0b268111c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:04.415473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399657-debd-41b4-bd3c-1fc0b268111c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:04.416910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8399657-debd-41b4-bd3c-1fc0b268111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:04.470791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b8399657-debd-41b4-bd3c-1fc0b268111c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:04.472423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b8399657-debd-41b4-bd3c-1fc0b268111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:04.580044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2fcf0-5860-4a1e-9190-ba067e051c3a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:04.613355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:04.650964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 922/1855] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:04.652586 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a3b5-9f58-401d-b626-3088c327b3f5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:04.652871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a3b5-9f58-401d-b626-3088c327b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:04.653151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a3b5-9f58-401d-b626-3088c327b3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:04.727644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2536a3b5-9f58-401d-b626-3088c327b3f5 None None] MFA Rules not processed for user `d4e8e2ea2d004a61a7d020ebbfb934ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:04.728988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2536a3b5-9f58-401d-b626-3088c327b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:04.836939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:04.838067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:04.838566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:04.839055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] PATH_INFO: `/v3/users/49d7ee2b74a54077ad085d76f294f8f5` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:04.841377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d7ee2b74a54077ad085d76f294f8f5)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:04.845809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:04.900474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 923/1856] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:04.901263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a3b5-9f58-401d-b626-3088c327b3f5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:04.902657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2536a3b5-9f58-401d-b626-3088c327b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:04.981597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a3b5-9f58-401d-b626-3088c327b3f5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:04.986100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:04.986753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:04.987084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:04.987411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:04.999133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:05.000806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:05.015820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 924/1857] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:05.016951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:05.018085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d7ee2b74a54077ad085d76f294f8f5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:05.019123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:05.063178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d7ee2b74a54077ad085d76f294f8f5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:05.089088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d7ee2b74a54077ad085d76f294f8f5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:05.089948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d7ee2b74a54077ad085d76f294f8f5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:05.091266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d7ee2b74a54077ad085d76f294f8f5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:05.094408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:05.132167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 934/1858] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:04 2022] DELETE /identity/v3/users/49d7ee2b74a54077ad085d76f294f8f5 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:05.170891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1ce8d-d57d-4c8e-add3-7c4aba066a70 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:05.244557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:05.283777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:05.287556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:05.290177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:05.291981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:05.298294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:05.430686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:05.432959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:05.450690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 925/1859] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:06.485873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:06.486972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:06.494015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:06.495595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:06.562024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2e34e-70f7-4908-9784-d530dd2a4df1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:06.575314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e520d1-532f-465c-855c-ba1d3552a20e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:06.575995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e520d1-532f-465c-855c-ba1d3552a20e service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:06.576283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e520d1-532f-465c-855c-ba1d3552a20e service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:06.578003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e520d1-532f-465c-855c-ba1d3552a20e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:06.586797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e7e520d1-532f-465c-855c-ba1d3552a20e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:06.688706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc80e2-be6a-47fd-a5d2-d032e370c8b8 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:06.696801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:06.697678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:06.698126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:06.698541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] PATH_INFO: `/v3/projects/896ea0987e774b51abd7b990f38ae241` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:06.700046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896ea0987e774b51abd7b990f38ae241)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:06.702440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:06.770973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e520d1-532f-465c-855c-ba1d3552a20e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:06.775276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e520d1-532f-465c-855c-ba1d3552a20e service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:06.822903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896ea0987e774b51abd7b990f38ae241', 'request_id': 'req-37c946fe-e64c-4531-92fe-22fddaaf82c5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:06.823332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 935/1860] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:06.833942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896ea0987e774b51abd7b990f38ae241', 'request_id': 'req-37c946fe-e64c-4531-92fe-22fddaaf82c5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:06.855446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896ea0987e774b51abd7b990f38ae241', 'request_id': 'req-37c946fe-e64c-4531-92fe-22fddaaf82c5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:06.905558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] The token cache is being invalidate because project 896ea0987e774b51abd7b990f38ae241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:06.906297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:06.908334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:06.914041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 926/1861] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:06 2022] DELETE /identity/v3/projects/896ea0987e774b51abd7b990f38ae241 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:06.923353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7384c5-a723-4723-a45b-e05f483a29f2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:06.925806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7384c5-a723-4723-a45b-e05f483a29f2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:06.927636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7384c5-a723-4723-a45b-e05f483a29f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:06.981117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9e7384c5-a723-4723-a45b-e05f483a29f2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:06.982745 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9e7384c5-a723-4723-a45b-e05f483a29f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:07.181224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:07.183578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:07.240623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 936/1862] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:07.241820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:07.256215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0e5f-d9af-4d2a-b654-7c1a03ceb109 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:07.256215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0e5f-d9af-4d2a-b654-7c1a03ceb109 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:07.256997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0e5f-d9af-4d2a-b654-7c1a03ceb109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:07.347282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-871a0e5f-d9af-4d2a-b654-7c1a03ceb109 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:07.370098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-871a0e5f-d9af-4d2a-b654-7c1a03ceb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:07.407688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c946fe-e64c-4531-92fe-22fddaaf82c5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:07.410396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 937/1863] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:07.416355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a0e5f-d9af-4d2a-b654-7c1a03ceb109 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:07.433017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:07.433881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:07.434382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:07.434891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] PATH_INFO: `/v3/projects/fe1f853421ba46a28c3bcf639f21755b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:07.436539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1f853421ba46a28c3bcf639f21755b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:07.444553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:07.448163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a0e5f-d9af-4d2a-b654-7c1a03ceb109 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:07.472679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:07.474083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:07.474465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:07.474671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:07.475365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:07.475667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:07.478328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:07.527825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 938/1864] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:07.533569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:07.557277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77121e01-6d32-441e-9f36-0375f68b32ba admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:07.572973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1f853421ba46a28c3bcf639f21755b', 'request_id': 'req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.592884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1f853421ba46a28c3bcf639f21755b', 'request_id': 'req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.608183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1f853421ba46a28c3bcf639f21755b', 'request_id': 'req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.628888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] The token cache is being invalidate because project fe1f853421ba46a28c3bcf639f21755b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:07.629576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.630591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.633174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 927/1865] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:07 2022] DELETE /identity/v3/projects/fe1f853421ba46a28c3bcf639f21755b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:07.637297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:07.639229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:07.745919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfd95-c85f-42d2-8144-fa026ddcf14d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:07.760446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:07.760446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:07.760446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:07.760446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] PATH_INFO: `/v3/users/2399b8e81dfc488291edb552e1f1c54b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:07.760950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2399b8e81dfc488291edb552e1f1c54b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:07.760950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:07.765453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:07.766392 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:07.766988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:07.767512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:07.768525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:07.771020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:07.796207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:07.826579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 939/1866] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:07 2022] POST /identity/v3/projects => generated 369 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:07.833319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:07.846586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:07.861510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2399b8e81dfc488291edb552e1f1c54b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.868752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:07.884951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2399b8e81dfc488291edb552e1f1c54b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.886656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2399b8e81dfc488291edb552e1f1c54b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.888916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2399b8e81dfc488291edb552e1f1c54b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.923939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2399b8e81dfc488291edb552e1f1c54b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:07.959224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 928/1867] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:07 2022] DELETE /identity/v3/users/2399b8e81dfc488291edb552e1f1c54b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:08.058234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775943d2-8bcc-4643-990d-77b945e38461 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:08.203605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67030c85-4c68-4c86-bbd6-d05d9857eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:08.205201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67030c85-4c68-4c86-bbd6-d05d9857eb99 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:08.207062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67030c85-4c68-4c86-bbd6-d05d9857eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:08.208461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67030c85-4c68-4c86-bbd6-d05d9857eb99 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:08.210344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67030c85-4c68-4c86-bbd6-d05d9857eb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:08.215452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67030c85-4c68-4c86-bbd6-d05d9857eb99 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:08.262962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 940/1868] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:07 2022] POST /identity/v3/users => generated 285 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:08.264250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:08.266079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:08.293526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d5743-9e42-45c4-a976-a77ec634978e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:08.303521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d816-de1a-418b-9749-506e7a602a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:08.305654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d816-de1a-418b-9749-506e7a602a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:08.306728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d816-de1a-418b-9749-506e7a602a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:08.307270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d816-de1a-418b-9749-506e7a602a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:08.308183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6d816-de1a-418b-9749-506e7a602a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:08.312456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6d816-de1a-418b-9749-506e7a602a1c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:08.348168 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 929/1869] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:08.349731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67030c85-4c68-4c86-bbd6-d05d9857eb99 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:08.368926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67030c85-4c68-4c86-bbd6-d05d9857eb99 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:08.378190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37984c-04e0-4ede-bf63-a750efcffbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:08.380349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37984c-04e0-4ede-bf63-a750efcffbff admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:08.380984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37984c-04e0-4ede-bf63-a750efcffbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:08.381572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37984c-04e0-4ede-bf63-a750efcffbff admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:08.382764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37984c-04e0-4ede-bf63-a750efcffbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:08.385896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37984c-04e0-4ede-bf63-a750efcffbff admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:08.409742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d816-de1a-418b-9749-506e7a602a1c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:08.410399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 941/1870] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:08.460690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d816-de1a-418b-9749-506e7a602a1c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:08.468166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:08.471768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:08.474259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:08.474615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] PATH_INFO: `/v3/projects/342a2195dde64a93ab897228efb36ee4/users/f9e3b3f85d1143589114912c96047dd0/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:08.554150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342a2195dde64a93ab897228efb36ee4, user_id=f9e3b3f85d1143589114912c96047dd0, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:08.562803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:08.609319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 930/1871] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:08 2022] PUT /identity/v3/projects/342a2195dde64a93ab897228efb36ee4/users/f9e3b3f85d1143589114912c96047dd0/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:08.633140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803d2e-e952-4b80-b580-2dd403eed2b3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:08.633677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803d2e-e952-4b80-b580-2dd403eed2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:08.634142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803d2e-e952-4b80-b580-2dd403eed2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:08.739770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-49803d2e-e952-4b80-b580-2dd403eed2b3 None None] MFA Rules not processed for user `f9e3b3f85d1143589114912c96047dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:08.740595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-49803d2e-e952-4b80-b580-2dd403eed2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:08.923323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 942/1872] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:08.939425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:08.942593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:09.176704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b55434-ff5b-403d-bd45-9b3f6d8d1799 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:09.180935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c6ee4-40f9-4c10-9ecb-98ad3b2d73fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7ccabe29f4464bafbdd7b5aab7d775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:09.181686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c6ee4-40f9-4c10-9ecb-98ad3b2d73fe service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.182013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c6ee4-40f9-4c10-9ecb-98ad3b2d73fe service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.182457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c6ee4-40f9-4c10-9ecb-98ad3b2d73fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.188679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49803d2e-e952-4b80-b580-2dd403eed2b3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:09.190514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-49803d2e-e952-4b80-b580-2dd403eed2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:09.210139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c6ee4-40f9-4c10-9ecb-98ad3b2d73fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:09.212364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c6ee4-40f9-4c10-9ecb-98ad3b2d73fe service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:09.217060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:09.240804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 931/1873] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:09.325065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49803d2e-e952-4b80-b580-2dd403eed2b3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:09.339362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:09.340189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.340510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.340789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] PATH_INFO: `/v3/projects/40b478aa4c334a4484aefb4ba6f30ff6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.342054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b478aa4c334a4484aefb4ba6f30ff6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:09.344270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:09.418840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b478aa4c334a4484aefb4ba6f30ff6', 'request_id': 'req-076a2494-f33a-4c77-8f76-f00fe882ac42'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:09.433169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b478aa4c334a4484aefb4ba6f30ff6', 'request_id': 'req-076a2494-f33a-4c77-8f76-f00fe882ac42'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:09.451826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b478aa4c334a4484aefb4ba6f30ff6', 'request_id': 'req-076a2494-f33a-4c77-8f76-f00fe882ac42'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:09.456825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6e63-bebc-4f48-90e1-b1bcc0926560 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.459239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6e63-bebc-4f48-90e1-b1bcc0926560 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.459534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6e63-bebc-4f48-90e1-b1bcc0926560 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.461945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 932/1874] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:33:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:33:09.482026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] The token cache is being invalidate because project 40b478aa4c334a4484aefb4ba6f30ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:09.482672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:09.483986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-076a2494-f33a-4c77-8f76-f00fe882ac42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:09.492465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 943/1875] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:09 2022] DELETE /identity/v3/projects/40b478aa4c334a4484aefb4ba6f30ff6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:09.492729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd684f8-cf1c-4712-838d-b45d981cd26a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.492729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd684f8-cf1c-4712-838d-b45d981cd26a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.492729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd684f8-cf1c-4712-838d-b45d981cd26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.497658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11329bf-5197-46fc-97f4-ae26554cca80 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.497945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11329bf-5197-46fc-97f4-ae26554cca80 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.499008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11329bf-5197-46fc-97f4-ae26554cca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.549116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ffd684f8-cf1c-4712-838d-b45d981cd26a None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:09.551369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ffd684f8-cf1c-4712-838d-b45d981cd26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:09.576849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d11329bf-5197-46fc-97f4-ae26554cca80 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:09.578173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d11329bf-5197-46fc-97f4-ae26554cca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:09.757372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 933/1876] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:09.759038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 944/1877] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:09.769475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817fd4f-3321-4cf1-a9a5-0f4330857be9 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.769783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817fd4f-3321-4cf1-a9a5-0f4330857be9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.770399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817fd4f-3321-4cf1-a9a5-0f4330857be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.775249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11329bf-5197-46fc-97f4-ae26554cca80 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:09.779565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d11329bf-5197-46fc-97f4-ae26554cca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:09.806776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c817fd4f-3321-4cf1-a9a5-0f4330857be9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:09.809824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c817fd4f-3321-4cf1-a9a5-0f4330857be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:09.810511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11329bf-5197-46fc-97f4-ae26554cca80 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:09.828837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6b19-3ccd-428d-a7c5-8a3acaba0ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:09.830526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6b19-3ccd-428d-a7c5-8a3acaba0ffd service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.830526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6b19-3ccd-428d-a7c5-8a3acaba0ffd service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.831376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6b19-3ccd-428d-a7c5-8a3acaba0ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.836263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 934/1878] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:09.851138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817fd4f-3321-4cf1-a9a5-0f4330857be9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:09.859584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:09.866662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b6b19-3ccd-428d-a7c5-8a3acaba0ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:09.871928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b6b19-3ccd-428d-a7c5-8a3acaba0ffd service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:09.873572 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817fd4f-3321-4cf1-a9a5-0f4330857be9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:09.893075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:09.894124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.895301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.895738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.897822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:09.898658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:09.902383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:09.907616 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 945/1879] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:33:09.936335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 935/1880] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:09.942392 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6b19-3ccd-428d-a7c5-8a3acaba0ffd service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:09.961624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6b19-3ccd-428d-a7c5-8a3acaba0ffd service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:09.974953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bda25-096d-4d56-b339-2a931afc581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:09.975984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bda25-096d-4d56-b339-2a931afc581c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:09.976469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bda25-096d-4d56-b339-2a931afc581c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:09.976859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bda25-096d-4d56-b339-2a931afc581c admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:09.977691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bda25-096d-4d56-b339-2a931afc581c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:09.982703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bda25-096d-4d56-b339-2a931afc581c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:10.126887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:10.137959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 946/1881] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:09 2022] POST /identity/v3/projects => generated 361 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:10.151225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372555d-146f-477e-9be7-f0666c493916 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:10.326509 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b9e94-79c7-4613-a051-d31d484fcd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:10.327437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9e94-79c7-4613-a051-d31d484fcd7c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:10.327805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9e94-79c7-4613-a051-d31d484fcd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:10.328177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9e94-79c7-4613-a051-d31d484fcd7c admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:10.331271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b9e94-79c7-4613-a051-d31d484fcd7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:10.334286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b9e94-79c7-4613-a051-d31d484fcd7c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:10.405204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 936/1882] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:10 2022] POST /identity/v3/users => generated 281 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:10.409696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bda25-096d-4d56-b339-2a931afc581c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:10.427065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bda25-096d-4d56-b339-2a931afc581c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:10.439415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5771b-1af6-4fbc-801f-ed17c8ba2c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:10.440134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5771b-1af6-4fbc-801f-ed17c8ba2c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:10.440438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5771b-1af6-4fbc-801f-ed17c8ba2c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:10.440715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5771b-1af6-4fbc-801f-ed17c8ba2c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:10.441375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5771b-1af6-4fbc-801f-ed17c8ba2c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:10.444065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5771b-1af6-4fbc-801f-ed17c8ba2c86 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:10.449727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:10.476501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 947/1883] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:10.481171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b9e94-79c7-4613-a051-d31d484fcd7c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:10.498383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b9e94-79c7-4613-a051-d31d484fcd7c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:10.506242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfc1a4-0b2c-4893-8298-2f960c2b8583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:10.507410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc1a4-0b2c-4893-8298-2f960c2b8583 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:10.508001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc1a4-0b2c-4893-8298-2f960c2b8583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:10.508567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc1a4-0b2c-4893-8298-2f960c2b8583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:10.509435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfc1a4-0b2c-4893-8298-2f960c2b8583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:10.511608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfc1a4-0b2c-4893-8298-2f960c2b8583 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:10.545284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 937/1884] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:10.547231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5771b-1af6-4fbc-801f-ed17c8ba2c86 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:10.581249 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5771b-1af6-4fbc-801f-ed17c8ba2c86 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:10.592951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:10.593716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:10.593992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:10.594302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] PATH_INFO: `/v3/projects/ccf045da6a1d4bc1ad43e38ff549d556/users/9b580af5a7df48e09180ac166181a457/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:10.637985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf045da6a1d4bc1ad43e38ff549d556, user_id=9b580af5a7df48e09180ac166181a457, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:10.649983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:10.697937 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 948/1885] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:10 2022] PUT /identity/v3/projects/ccf045da6a1d4bc1ad43e38ff549d556/users/9b580af5a7df48e09180ac166181a457/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:10.699815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3532-c485-4cf5-8fe9-f172027a33b8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:10.700506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3532-c485-4cf5-8fe9-f172027a33b8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:10.701020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3532-c485-4cf5-8fe9-f172027a33b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:10.796418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7e4d3532-c485-4cf5-8fe9-f172027a33b8 None None] MFA Rules not processed for user `9b580af5a7df48e09180ac166181a457`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:10.799286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7e4d3532-c485-4cf5-8fe9-f172027a33b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:11.001458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 938/1886] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:11.058384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:11.061397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:11.201379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41a22c-811f-4ab1-8092-39e0564620e1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:11.207594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1015-b5f0-4aef-996a-80508d916e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:11.209082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1015-b5f0-4aef-996a-80508d916e2f service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:11.209531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1015-b5f0-4aef-996a-80508d916e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:11.209899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1015-b5f0-4aef-996a-80508d916e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:11.228189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1015-b5f0-4aef-996a-80508d916e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:11.229905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1015-b5f0-4aef-996a-80508d916e2f service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:11.249650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 949/1887] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:11.268631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d3532-c485-4cf5-8fe9-f172027a33b8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:11.312888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56f500-7f7b-498b-ab23-b6d3e7905afa None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:11.313214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56f500-7f7b-498b-ab23-b6d3e7905afa None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:11.313676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56f500-7f7b-498b-ab23-b6d3e7905afa None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:11.316532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 950/1888] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:33:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:33:11.324633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4f7b-5f3b-4001-82cd-d6d2e708f867 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:11.324903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4f7b-5f3b-4001-82cd-d6d2e708f867 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:11.325452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4f7b-5f3b-4001-82cd-d6d2e708f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:11.369436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-248a4f7b-5f3b-4001-82cd-d6d2e708f867 None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:11.371499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-248a4f7b-5f3b-4001-82cd-d6d2e708f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:11.443478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:11.455194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d3532-c485-4cf5-8fe9-f172027a33b8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:11.488037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:11.488781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:11.489080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:11.489341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] PATH_INFO: `/v3/users/9b580af5a7df48e09180ac166181a457` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:11.492641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b580af5a7df48e09180ac166181a457)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:11.494713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:11.573340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 951/1889] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:11.596635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b580af5a7df48e09180ac166181a457'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:11.617411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a4f7b-5f3b-4001-82cd-d6d2e708f867 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:11.623550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b580af5a7df48e09180ac166181a457'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:11.626441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b580af5a7df48e09180ac166181a457'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:11.628517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b580af5a7df48e09180ac166181a457'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:11.639138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a4f7b-5f3b-4001-82cd-d6d2e708f867 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:11.650453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-81b48459-414b-441d-936e-a10c9ffd58be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b580af5a7df48e09180ac166181a457'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:11.654299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:11.656581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:11.656927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:11.657160 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:11.659651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:11.687490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:11.692793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:11.722385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 939/1890] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:11 2022] DELETE /identity/v3/users/9b580af5a7df48e09180ac166181a457 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:11.729102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d338765-c42b-48fd-a588-0efc73b90d07 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:11.729487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d338765-c42b-48fd-a588-0efc73b90d07 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:11.732001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d338765-c42b-48fd-a588-0efc73b90d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:11.733908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 952/1891] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:33:11.788794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7d338765-c42b-48fd-a588-0efc73b90d07 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:11.788794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7d338765-c42b-48fd-a588-0efc73b90d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:11.896849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 940/1892] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:11.909392 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:11.911794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:12.017717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929487b8-9eb2-40a4-b734-736b6bcaa8d7 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:12.040551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:12.120581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:12.121614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:12.121874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:12.122268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:12.139985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:12.142522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:12.160138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 953/1893] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:33:12.720726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d338765-c42b-48fd-a588-0efc73b90d07 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:12.724550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7d338765-c42b-48fd-a588-0efc73b90d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:12.926532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d338765-c42b-48fd-a588-0efc73b90d07 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:12.958579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8bb29-bfbd-46a8-9a01-969bb98ab28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:12.961231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bb29-bfbd-46a8-9a01-969bb98ab28c service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:12.963313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bb29-bfbd-46a8-9a01-969bb98ab28c service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:12.963862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bb29-bfbd-46a8-9a01-969bb98ab28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:12.975144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4cf8bb29-bfbd-46a8-9a01-969bb98ab28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:13.063445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:13.136665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8bb29-bfbd-46a8-9a01-969bb98ab28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:13.139953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8bb29-bfbd-46a8-9a01-969bb98ab28c service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:13.159092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 941/1894] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:13.883211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:13.888261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:13.934421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb368972-b6e6-4cb3-8e3c-15c8ec9b2efc service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:13.948124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:13.949583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:13.950378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:13.951663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] PATH_INFO: `/v3/projects/ccf045da6a1d4bc1ad43e38ff549d556` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:13.954383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf045da6a1d4bc1ad43e38ff549d556)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:13.961756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:14.078420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf045da6a1d4bc1ad43e38ff549d556', 'request_id': 'req-34541419-23ca-468a-b34c-2f79a3ab4b69'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:14.094755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf045da6a1d4bc1ad43e38ff549d556', 'request_id': 'req-34541419-23ca-468a-b34c-2f79a3ab4b69'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:14.104218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf045da6a1d4bc1ad43e38ff549d556', 'request_id': 'req-34541419-23ca-468a-b34c-2f79a3ab4b69'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:14.118650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] The token cache is being invalidate because project ccf045da6a1d4bc1ad43e38ff549d556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:14.119113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:14.121131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-34541419-23ca-468a-b34c-2f79a3ab4b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:14.126837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 954/1895] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:13 2022] DELETE /identity/v3/projects/ccf045da6a1d4bc1ad43e38ff549d556 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:14.129549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e07d2-94d5-458d-9166-fd43a830788d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.130482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e07d2-94d5-458d-9166-fd43a830788d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.131131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e07d2-94d5-458d-9166-fd43a830788d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.157877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-913e07d2-94d5-458d-9166-fd43a830788d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:14.160787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-913e07d2-94d5-458d-9166-fd43a830788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:14.243745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 942/1896] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:14.251782 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796577-1814-420c-8fa6-93c13efc03da None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.252114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796577-1814-420c-8fa6-93c13efc03da None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.252499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796577-1814-420c-8fa6-93c13efc03da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.282042 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1a796577-1814-420c-8fa6-93c13efc03da None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:14.283387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1a796577-1814-420c-8fa6-93c13efc03da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:14.293211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 955/1897] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:14.303154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e07d2-94d5-458d-9166-fd43a830788d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:14.314669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e07d2-94d5-458d-9166-fd43a830788d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:14.320879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:14.321169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.321319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.321588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.322514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:14.322932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:14.325306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:14.356173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 943/1898] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:14.361213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a796577-1814-420c-8fa6-93c13efc03da None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:14.376505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a796577-1814-420c-8fa6-93c13efc03da None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:14.383990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e67a5-2771-4e3e-8c20-cc1aa32994b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:14.388645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e67a5-2771-4e3e-8c20-cc1aa32994b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.388645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e67a5-2771-4e3e-8c20-cc1aa32994b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.388645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e67a5-2771-4e3e-8c20-cc1aa32994b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.388645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e67a5-2771-4e3e-8c20-cc1aa32994b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:14.391382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e67a5-2771-4e3e-8c20-cc1aa32994b8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:14.431832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 956/1899] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:14 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:14.436661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:14.448441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a567ce8-3931-45d0-8f58-fa0b8471aa9e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:14.557435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857791f-4e3c-4fda-8bf8-a86c3e44d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:14.558051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857791f-4e3c-4fda-8bf8-a86c3e44d1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.558635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857791f-4e3c-4fda-8bf8-a86c3e44d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.558917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857791f-4e3c-4fda-8bf8-a86c3e44d1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.559662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857791f-4e3c-4fda-8bf8-a86c3e44d1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:14.563040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857791f-4e3c-4fda-8bf8-a86c3e44d1b2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:14.601994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 944/1900] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:14 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:14.606130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e67a5-2771-4e3e-8c20-cc1aa32994b8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:14.636583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e67a5-2771-4e3e-8c20-cc1aa32994b8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:14.651177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215a0f6-c0bd-4cb0-85a5-63f854117dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:14.652845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215a0f6-c0bd-4cb0-85a5-63f854117dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.653620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215a0f6-c0bd-4cb0-85a5-63f854117dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.656337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215a0f6-c0bd-4cb0-85a5-63f854117dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.657449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215a0f6-c0bd-4cb0-85a5-63f854117dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:14.659886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215a0f6-c0bd-4cb0-85a5-63f854117dbb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:14.679722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 957/1901] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:14.685687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857791f-4e3c-4fda-8bf8-a86c3e44d1b2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:14.724298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857791f-4e3c-4fda-8bf8-a86c3e44d1b2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:14.746531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd0a5-b118-44b3-af15-7be1ec6f6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:14.747300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd0a5-b118-44b3-af15-7be1ec6f6037 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.747646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd0a5-b118-44b3-af15-7be1ec6f6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.748066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd0a5-b118-44b3-af15-7be1ec6f6037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.748880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd0a5-b118-44b3-af15-7be1ec6f6037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:14.750662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd0a5-b118-44b3-af15-7be1ec6f6037 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:14.771773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 945/1902] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:14.773766 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215a0f6-c0bd-4cb0-85a5-63f854117dbb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:14.799647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215a0f6-c0bd-4cb0-85a5-63f854117dbb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:14.806224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:14.807140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.807596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.808162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] PATH_INFO: `/v3/projects/32e9718328fd4288bb3a61cfd4d14238/users/5ee12aa8c48d4b81a247ab338ae9a804/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.845174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e9718328fd4288bb3a61cfd4d14238, user_id=5ee12aa8c48d4b81a247ab338ae9a804, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:14.851874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:14.894209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 958/1903] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:14 2022] PUT /identity/v3/projects/32e9718328fd4288bb3a61cfd4d14238/users/5ee12aa8c48d4b81a247ab338ae9a804/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:14.902516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebacb82-3107-403b-99e7-228c86aec8f7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:14.902516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebacb82-3107-403b-99e7-228c86aec8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:14.902516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebacb82-3107-403b-99e7-228c86aec8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:14.964254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7ebacb82-3107-403b-99e7-228c86aec8f7 None None] MFA Rules not processed for user `5ee12aa8c48d4b81a247ab338ae9a804`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:14.966099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7ebacb82-3107-403b-99e7-228c86aec8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:15.045318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:15.133916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 946/1904] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:15.149031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:15.151796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:15.242803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:15.287795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d659ce8-f8a0-49af-b8ea-04b69bf54546 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:15.292504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964673ad-73e1-4dad-a22e-e7b4f3d7b217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:15.293284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964673ad-73e1-4dad-a22e-e7b4f3d7b217 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:15.293582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964673ad-73e1-4dad-a22e-e7b4f3d7b217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:15.293842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964673ad-73e1-4dad-a22e-e7b4f3d7b217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:15.306739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964673ad-73e1-4dad-a22e-e7b4f3d7b217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:15.309692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964673ad-73e1-4dad-a22e-e7b4f3d7b217 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:15.331765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 959/1905] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:15.363446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebacb82-3107-403b-99e7-228c86aec8f7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:15.489407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebacb82-3107-403b-99e7-228c86aec8f7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:15.494507 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:15.495187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:15.495456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:15.495735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] PATH_INFO: `/v3/users/5ee12aa8c48d4b81a247ab338ae9a804` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:15.496928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee12aa8c48d4b81a247ab338ae9a804)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:15.499255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:15.657326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee12aa8c48d4b81a247ab338ae9a804'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:15.696819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee12aa8c48d4b81a247ab338ae9a804'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:15.714930 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee12aa8c48d4b81a247ab338ae9a804'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:15.716263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee12aa8c48d4b81a247ab338ae9a804'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:15.732150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee12aa8c48d4b81a247ab338ae9a804'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:15.774042 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 947/1906] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:15 2022] DELETE /identity/v3/users/5ee12aa8c48d4b81a247ab338ae9a804 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:15.778137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9d336-7b3e-4a57-9c3b-d5534a48f197 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:15.779008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9d336-7b3e-4a57-9c3b-d5534a48f197 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:15.779566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9d336-7b3e-4a57-9c3b-d5534a48f197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:15.846004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ecf9d336-7b3e-4a57-9c3b-d5534a48f197 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:15.847761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ecf9d336-7b3e-4a57-9c3b-d5534a48f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:15.992763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 960/1907] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:16.004627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:16.006584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:16.086474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:16.095162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951fc74-6763-41e1-88fd-a3dd44eb971b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:16.113209 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b5bf-d5e7-4528-8008-68de6c11003e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:16.114446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b5bf-d5e7-4528-8008-68de6c11003e service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:16.115099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b5bf-d5e7-4528-8008-68de6c11003e service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:16.115409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b5bf-d5e7-4528-8008-68de6c11003e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:16.142871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b5bf-d5e7-4528-8008-68de6c11003e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:16.146761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b5bf-d5e7-4528-8008-68de6c11003e service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:16.168189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 948/1908] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:16.318152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9d336-7b3e-4a57-9c3b-d5534a48f197 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:16.319764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ecf9d336-7b3e-4a57-9c3b-d5534a48f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:16.333296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9d336-7b3e-4a57-9c3b-d5534a48f197 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:16.352284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:16.358352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:16.359173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:16.359678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] PATH_INFO: `/v3/users/fe2774972702418092829d1aef896ceb` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:16.362116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2774972702418092829d1aef896ceb)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:16.366061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:16.453769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2774972702418092829d1aef896ceb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:16.475612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2774972702418092829d1aef896ceb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:16.499801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2774972702418092829d1aef896ceb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:16.501631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2774972702418092829d1aef896ceb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:16.505225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2774972702418092829d1aef896ceb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:16.559176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 961/1909] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:16 2022] DELETE /identity/v3/users/fe2774972702418092829d1aef896ceb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:16.560911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438ae1-d2bb-4ca7-ac12-2c81e5c04df3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:16.561407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438ae1-d2bb-4ca7-ac12-2c81e5c04df3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:16.561828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438ae1-d2bb-4ca7-ac12-2c81e5c04df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:16.623207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-63438ae1-d2bb-4ca7-ac12-2c81e5c04df3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:16.628049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-63438ae1-d2bb-4ca7-ac12-2c81e5c04df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:16.788102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:16.790479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:16.876490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 949/1910] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:16.893274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438ae1-d2bb-4ca7-ac12-2c81e5c04df3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:16.895962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-63438ae1-d2bb-4ca7-ac12-2c81e5c04df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:16.958396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:17.021359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670534a8-679b-49eb-806a-5946abf8ed3b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:17.031209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:17.032915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:17.034099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:17.034791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] PATH_INFO: `/v3/projects/32e9718328fd4288bb3a61cfd4d14238` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:17.037176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e9718328fd4288bb3a61cfd4d14238)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:17.041255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:17.087484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438ae1-d2bb-4ca7-ac12-2c81e5c04df3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:17.097428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34420054-af84-43d2-9ba6-0413bcba5dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:17.098469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34420054-af84-43d2-9ba6-0413bcba5dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:17.098918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34420054-af84-43d2-9ba6-0413bcba5dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:17.099427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34420054-af84-43d2-9ba6-0413bcba5dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:17.132474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34420054-af84-43d2-9ba6-0413bcba5dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:17.135559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34420054-af84-43d2-9ba6-0413bcba5dcf service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:17.154364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 950/1911] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:17.309849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e9718328fd4288bb3a61cfd4d14238', 'request_id': 'req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:17.331042 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e9718328fd4288bb3a61cfd4d14238', 'request_id': 'req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:17.347589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e9718328fd4288bb3a61cfd4d14238', 'request_id': 'req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:17.381188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] The token cache is being invalidate because project 32e9718328fd4288bb3a61cfd4d14238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:17.382351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:17.393354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bf66de4f-bd7b-4792-b005-9d7e8fcb6ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:17.397077 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 962/1912] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:16 2022] DELETE /identity/v3/projects/32e9718328fd4288bb3a61cfd4d14238 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:17.403304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85450-1694-44a5-9c26-186068f47412 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:17.403802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85450-1694-44a5-9c26-186068f47412 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:17.404290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85450-1694-44a5-9c26-186068f47412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:17.478287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c5e85450-1694-44a5-9c26-186068f47412 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:17.480211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c5e85450-1694-44a5-9c26-186068f47412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:17.767422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 951/1913] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:17.785842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afca0c-d103-40fe-bfc9-3e9f18fe7eb2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:17.786764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afca0c-d103-40fe-bfc9-3e9f18fe7eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:17.787218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afca0c-d103-40fe-bfc9-3e9f18fe7eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:17.857769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-07afca0c-d103-40fe-bfc9-3e9f18fe7eb2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:17.860043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-07afca0c-d103-40fe-bfc9-3e9f18fe7eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:17.880892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e85450-1694-44a5-9c26-186068f47412 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:17.883154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c5e85450-1694-44a5-9c26-186068f47412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:17.899325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 963/1914] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:17.910302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afca0c-d103-40fe-bfc9-3e9f18fe7eb2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:17.948261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afca0c-d103-40fe-bfc9-3e9f18fe7eb2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:17.956018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e85450-1694-44a5-9c26-186068f47412 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:17.967144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:17.967694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:17.967971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:17.968439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:17.968633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:17.969332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:17.969745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:17.970126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:17.970647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:17.971412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] PATH_INFO: `/v3/projects/a2969c45f302477fab40f28f3dc63f58` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:17.973692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:17.978154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2969c45f302477fab40f28f3dc63f58)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:17.984880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:18.027675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 964/1915] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:18.031142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:18.056015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a620496-6e0d-4bf2-932c-55c65d65fbd1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:18.068139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29b1e4-8bb2-4730-a511-cd15aa412206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:18.068944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29b1e4-8bb2-4730-a511-cd15aa412206 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:18.069416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29b1e4-8bb2-4730-a511-cd15aa412206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:18.069850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29b1e4-8bb2-4730-a511-cd15aa412206 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:18.070692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29b1e4-8bb2-4730-a511-cd15aa412206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:18.073078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29b1e4-8bb2-4730-a511-cd15aa412206 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:18.078805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:18.132519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2969c45f302477fab40f28f3dc63f58', 'request_id': 'req-044210b4-fcf9-4e55-b915-e06fc11c7332'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.177565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2969c45f302477fab40f28f3dc63f58', 'request_id': 'req-044210b4-fcf9-4e55-b915-e06fc11c7332'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.201876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 965/1916] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:18 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:18.206690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29b1e4-8bb2-4730-a511-cd15aa412206 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:18.206904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2969c45f302477fab40f28f3dc63f58', 'request_id': 'req-044210b4-fcf9-4e55-b915-e06fc11c7332'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.249050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] The token cache is being invalidate because project a2969c45f302477fab40f28f3dc63f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:18.249356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.250057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.253378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 952/1917] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:17 2022] DELETE /identity/v3/projects/a2969c45f302477fab40f28f3dc63f58 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:18.258299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:18.263602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:18.385387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29b1e4-8bb2-4730-a511-cd15aa412206 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:18.391093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:18.391872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:18.392210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:18.392882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:18.393132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:18.395115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:18.407363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044210b4-fcf9-4e55-b915-e06fc11c7332 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:18.412704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:18.413379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:18.413813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:18.414091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] PATH_INFO: `/v3/users/fa3fe59cda844e6a8c20aa19bd7cb00c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:18.416285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3fe59cda844e6a8c20aa19bd7cb00c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:18.418360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:18.427458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 966/1918] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:18 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:18.432564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:18.434787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:18.448313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013867-b371-437b-8f7e-b74d76b35205 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:18.457465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6180a6-c269-4729-adbb-45f9cfbb8ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:18.458149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6180a6-c269-4729-adbb-45f9cfbb8ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:18.459044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6180a6-c269-4729-adbb-45f9cfbb8ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:18.459596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6180a6-c269-4729-adbb-45f9cfbb8ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:18.465713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6180a6-c269-4729-adbb-45f9cfbb8ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:18.465713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6180a6-c269-4729-adbb-45f9cfbb8ad9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:18.474561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 967/1919] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:33:18.479335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6180a6-c269-4729-adbb-45f9cfbb8ad9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:18.490115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6180a6-c269-4729-adbb-45f9cfbb8ad9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:18.499598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:18.499872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3fe59cda844e6a8c20aa19bd7cb00c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.500259 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:18.500592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:18.500895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:18.501559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:18.503565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:18.511873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3fe59cda844e6a8c20aa19bd7cb00c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.512844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3fe59cda844e6a8c20aa19bd7cb00c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.514004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3fe59cda844e6a8c20aa19bd7cb00c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.517302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 968/1920] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:33:18.523200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:18.525267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:18.533735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:18.537100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-783f7c37-577b-4410-833f-c1ae7ae7f80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3fe59cda844e6a8c20aa19bd7cb00c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:18.540297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94563595-cabd-4da8-826a-37d634ba2e84 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:18.549990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:18.550832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:18.551432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:18.551840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] PATH_INFO: `/v3/projects/e7b161e06fa7483c8bb9d8d6b9840b06/users/fa40badfd3264acc962ae74d9688e452/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:18.563274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 953/1921] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:18 2022] DELETE /identity/v3/users/fa3fe59cda844e6a8c20aa19bd7cb00c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:18.579073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b161e06fa7483c8bb9d8d6b9840b06, user_id=fa40badfd3264acc962ae74d9688e452, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:18.582130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:18.600372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 969/1922] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:18 2022] PUT /identity/v3/projects/e7b161e06fa7483c8bb9d8d6b9840b06/users/fa40badfd3264acc962ae74d9688e452/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:18.616910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726d5d-a4c2-4380-a6e2-010414ffbc87 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:18.617436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726d5d-a4c2-4380-a6e2-010414ffbc87 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:18.617988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726d5d-a4c2-4380-a6e2-010414ffbc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:18.670190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7a726d5d-a4c2-4380-a6e2-010414ffbc87 None None] MFA Rules not processed for user `fa40badfd3264acc962ae74d9688e452`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:18.672271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7a726d5d-a4c2-4380-a6e2-010414ffbc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:18.724413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:18.804336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 954/1923] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:18.815418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:18.829285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:18.949401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf2281-0886-48fb-a219-d2a6bba10c2f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:18.956454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c13376-4421-4cb1-bf11-9e8de9a6b3d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:18.957568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c13376-4421-4cb1-bf11-9e8de9a6b3d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:18.958035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c13376-4421-4cb1-bf11-9e8de9a6b3d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:18.958752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c13376-4421-4cb1-bf11-9e8de9a6b3d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:18.975083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c13376-4421-4cb1-bf11-9e8de9a6b3d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:18.977411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c13376-4421-4cb1-bf11-9e8de9a6b3d0 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:18.997381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 970/1924] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:19.047161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726d5d-a4c2-4380-a6e2-010414ffbc87 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:19.051755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7a726d5d-a4c2-4380-a6e2-010414ffbc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:19.257413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726d5d-a4c2-4380-a6e2-010414ffbc87 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:19.283831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:19.285143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:19.285639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:19.286478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] PATH_INFO: `/v3/projects/24e385ae3a7840af88d4ebfaa2a672ce` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:19.289619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e385ae3a7840af88d4ebfaa2a672ce)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:19.299954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:19.536885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e385ae3a7840af88d4ebfaa2a672ce', 'request_id': 'req-1c4d4a42-538d-4821-b60e-8066c7a9c825'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:19.551107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e385ae3a7840af88d4ebfaa2a672ce', 'request_id': 'req-1c4d4a42-538d-4821-b60e-8066c7a9c825'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:19.575805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e385ae3a7840af88d4ebfaa2a672ce', 'request_id': 'req-1c4d4a42-538d-4821-b60e-8066c7a9c825'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:19.664589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] The token cache is being invalidate because project 24e385ae3a7840af88d4ebfaa2a672ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:19.665973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:19.667316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:19.673514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 955/1925] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:19 2022] DELETE /identity/v3/projects/24e385ae3a7840af88d4ebfaa2a672ce => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:19.682401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c13376-4421-4cb1-bf11-9e8de9a6b3d0 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:19.704675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c13376-4421-4cb1-bf11-9e8de9a6b3d0 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:19.997560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:20.000626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:20.001863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:20.002680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] PATH_INFO: `/v3/users/d4e8e2ea2d004a61a7d020ebbfb934ed` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:20.005615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e8e2ea2d004a61a7d020ebbfb934ed)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:20.010269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:20.140086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e8e2ea2d004a61a7d020ebbfb934ed'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.172994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e8e2ea2d004a61a7d020ebbfb934ed'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.194627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e8e2ea2d004a61a7d020ebbfb934ed'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.195869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e8e2ea2d004a61a7d020ebbfb934ed'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.196928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e8e2ea2d004a61a7d020ebbfb934ed'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.215954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:20.228965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 971/1926] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:19 2022] DELETE /identity/v3/users/d4e8e2ea2d004a61a7d020ebbfb934ed => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:20.425982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:20.428361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:20.452018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4a42-538d-4821-b60e-8066c7a9c825 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:20.548036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:20.558780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:20.559482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:20.559959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:20.560360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] PATH_INFO: `/v3/users/dac4ba8a818f412c95d224f8dacd60e2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:20.562487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac4ba8a818f412c95d224f8dacd60e2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:20.564877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:20.645767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac4ba8a818f412c95d224f8dacd60e2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.675291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac4ba8a818f412c95d224f8dacd60e2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.676297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac4ba8a818f412c95d224f8dacd60e2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.679342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac4ba8a818f412c95d224f8dacd60e2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.682507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:20.684067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:20.700197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-36b2c910-2cfd-47ff-ab6c-a3d262b4e88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac4ba8a818f412c95d224f8dacd60e2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.703097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012127ea-ef03-4418-b1c9-a37551a6e945 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:20.714634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:20.716112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:20.716751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:20.717248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] PATH_INFO: `/v3/projects/d9d4ce9421ab412988bc3876fce1b827` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:20.718808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d4ce9421ab412988bc3876fce1b827)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:20.723184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:20.725985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 956/1927] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:20 2022] DELETE /identity/v3/users/dac4ba8a818f412c95d224f8dacd60e2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:20.730571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ef513-3f1a-4862-bb55-6e025c615b2c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:20.730862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ef513-3f1a-4862-bb55-6e025c615b2c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:20.731145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ef513-3f1a-4862-bb55-6e025c615b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:20.762620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-139ef513-3f1a-4862-bb55-6e025c615b2c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:20.764124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-139ef513-3f1a-4862-bb55-6e025c615b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:20.794902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d4ce9421ab412988bc3876fce1b827', 'request_id': 'req-b95a512b-5742-448f-884d-cf60d6a7ea86'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.804036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d4ce9421ab412988bc3876fce1b827', 'request_id': 'req-b95a512b-5742-448f-884d-cf60d6a7ea86'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.811258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d4ce9421ab412988bc3876fce1b827', 'request_id': 'req-b95a512b-5742-448f-884d-cf60d6a7ea86'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.834665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] The token cache is being invalidate because project d9d4ce9421ab412988bc3876fce1b827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:20.834665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.834665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b95a512b-5742-448f-884d-cf60d6a7ea86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:20.836469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 972/1928] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:20 2022] DELETE /identity/v3/projects/d9d4ce9421ab412988bc3876fce1b827 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:20.839671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42697ae-4343-4c80-b50a-517b167c45a8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:20.839955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42697ae-4343-4c80-b50a-517b167c45a8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:20.840281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42697ae-4343-4c80-b50a-517b167c45a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:20.844532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 957/1929] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:20.853221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ef513-3f1a-4862-bb55-6e025c615b2c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:20.855768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-139ef513-3f1a-4862-bb55-6e025c615b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:20.865855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f42697ae-4343-4c80-b50a-517b167c45a8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:20.867394 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f42697ae-4343-4c80-b50a-517b167c45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:20.937352 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ef513-3f1a-4862-bb55-6e025c615b2c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:20.949528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 973/1930] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:20.964966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d8ff1-0002-46c7-837e-cfbd1c4ffd43 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:20.965231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d8ff1-0002-46c7-837e-cfbd1c4ffd43 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:20.965534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d8ff1-0002-46c7-837e-cfbd1c4ffd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:20.992997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:20.997055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1b6d8ff1-0002-46c7-837e-cfbd1c4ffd43 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:20.998978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1b6d8ff1-0002-46c7-837e-cfbd1c4ffd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:21.012163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 974/1931] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:21.017900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d8ff1-0002-46c7-837e-cfbd1c4ffd43 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:21.024091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7acb6a-5b29-4f6c-b93c-cda06265700b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:21.024857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7acb6a-5b29-4f6c-b93c-cda06265700b service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.025212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7acb6a-5b29-4f6c-b93c-cda06265700b service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.025564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7acb6a-5b29-4f6c-b93c-cda06265700b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.039207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7acb6a-5b29-4f6c-b93c-cda06265700b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:21.040819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7acb6a-5b29-4f6c-b93c-cda06265700b service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:21.046255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d8ff1-0002-46c7-837e-cfbd1c4ffd43 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:21.060550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:21.065533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.066110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.066665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.069413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:21.070628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 958/1932] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:33:21.072499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:21.079672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:21.131128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 975/1933] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:21.136064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7acb6a-5b29-4f6c-b93c-cda06265700b service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:21.157114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7acb6a-5b29-4f6c-b93c-cda06265700b service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:21.163863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1a103-b579-4fb1-9fac-24e790a59d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:21.164330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a103-b579-4fb1-9fac-24e790a59d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.164645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a103-b579-4fb1-9fac-24e790a59d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.164931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a103-b579-4fb1-9fac-24e790a59d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.165665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1a103-b579-4fb1-9fac-24e790a59d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:21.167636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1a103-b579-4fb1-9fac-24e790a59d73 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:21.204183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 959/1934] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:21 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:21.209833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:21.246347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03663bab-fb21-4d10-8ad1-586fba6e632c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:21.424797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87b976-ad9a-44a0-93a1-473611b33fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:21.425386 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87b976-ad9a-44a0-93a1-473611b33fae admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.426256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87b976-ad9a-44a0-93a1-473611b33fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.426717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87b976-ad9a-44a0-93a1-473611b33fae admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.427524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87b976-ad9a-44a0-93a1-473611b33fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:21.431954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87b976-ad9a-44a0-93a1-473611b33fae admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:21.488928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:21.522017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 976/1935] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:21 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:21.531076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1a103-b579-4fb1-9fac-24e790a59d73 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:21.554723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1a103-b579-4fb1-9fac-24e790a59d73 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:21.565943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfb35d-22cc-4538-9e9f-753438c51ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:21.567087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfb35d-22cc-4538-9e9f-753438c51ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.567639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfb35d-22cc-4538-9e9f-753438c51ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.568133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfb35d-22cc-4538-9e9f-753438c51ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.570317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfb35d-22cc-4538-9e9f-753438c51ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:21.574421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfb35d-22cc-4538-9e9f-753438c51ab7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:21.633986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 960/1936] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:21.646726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87b976-ad9a-44a0-93a1-473611b33fae admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:21.658950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87b976-ad9a-44a0-93a1-473611b33fae admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:21.670304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:21.671024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.672798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.675722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.676643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:21.678582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:21.694703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 977/1937] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:21.701578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfb35d-22cc-4538-9e9f-753438c51ab7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:21.719629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfb35d-22cc-4538-9e9f-753438c51ab7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:21.730570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021330c6-497c-409c-8de2-0a32ff8829d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:21.737325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021330c6-497c-409c-8de2-0a32ff8829d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.737698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021330c6-497c-409c-8de2-0a32ff8829d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.737987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021330c6-497c-409c-8de2-0a32ff8829d5 admin admin] PATH_INFO: `/v3/projects/12ce486f01484b02bd459d6ebb6f6c8b/users/e7e7d5e228ff40ee91cbd434fd96575b/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.779983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:21.780800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021330c6-497c-409c-8de2-0a32ff8829d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ce486f01484b02bd459d6ebb6f6c8b, user_id=e7e7d5e228ff40ee91cbd434fd96575b, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:21.782028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:21.788231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021330c6-497c-409c-8de2-0a32ff8829d5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:21.803446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950830b9-8201-4cef-9040-a85617c9077f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:21.816770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 961/1938] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:21 2022] PUT /identity/v3/projects/12ce486f01484b02bd459d6ebb6f6c8b/users/e7e7d5e228ff40ee91cbd434fd96575b/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:21.839214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10cdd4-343c-49cb-b5df-b22bf9ff9508 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.840628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10cdd4-343c-49cb-b5df-b22bf9ff9508 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.840943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10cdd4-343c-49cb-b5df-b22bf9ff9508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.901466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:21.902632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:21.903130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:21.903618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] PATH_INFO: `/v3/projects/3f1baaeb5c024ad7970f0ba9c874cb5e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:21.905210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1baaeb5c024ad7970f0ba9c874cb5e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:21.908557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:21.920216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ce10cdd4-343c-49cb-b5df-b22bf9ff9508 None None] MFA Rules not processed for user `e7e7d5e228ff40ee91cbd434fd96575b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:21.921559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ce10cdd4-343c-49cb-b5df-b22bf9ff9508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:21.999235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1baaeb5c024ad7970f0ba9c874cb5e', 'request_id': 'req-a6976ea5-1fb3-4d08-ad08-844e36a8322e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.019456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1baaeb5c024ad7970f0ba9c874cb5e', 'request_id': 'req-a6976ea5-1fb3-4d08-ad08-844e36a8322e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.037884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1baaeb5c024ad7970f0ba9c874cb5e', 'request_id': 'req-a6976ea5-1fb3-4d08-ad08-844e36a8322e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.071096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] The token cache is being invalidate because project 3f1baaeb5c024ad7970f0ba9c874cb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:22.071633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.073534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.078214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 978/1939] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:21 2022] DELETE /identity/v3/projects/3f1baaeb5c024ad7970f0ba9c874cb5e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:22.084440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 962/1940] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:22.084881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:22.086325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:22.090948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10cdd4-343c-49cb-b5df-b22bf9ff9508 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:22.106253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10cdd4-343c-49cb-b5df-b22bf9ff9508 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:22.205344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:22.205966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:22.206431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:22.206700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:22.207473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:22.210900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:22.212601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6976ea5-1fb3-4d08-ad08-844e36a8322e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:22.219913 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:22.220619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:22.221085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:22.221424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] PATH_INFO: `/v3/users/a64d20f2441c40ab82aa0cf2d3abca2d` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:22.222809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64d20f2441c40ab82aa0cf2d3abca2d)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:22.225087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:22.229157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:22.242694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:22.261937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 963/1941] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:22 2022] POST /identity/v3/projects => generated 391 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:22.263495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:22.266679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:22.306186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64d20f2441c40ab82aa0cf2d3abca2d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.323925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64d20f2441c40ab82aa0cf2d3abca2d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.334213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64d20f2441c40ab82aa0cf2d3abca2d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.335006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64d20f2441c40ab82aa0cf2d3abca2d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.336173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64d20f2441c40ab82aa0cf2d3abca2d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:22.353185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 979/1942] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:22 2022] DELETE /identity/v3/users/a64d20f2441c40ab82aa0cf2d3abca2d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:22.367927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fdc08-9943-476f-8cce-f334212d020b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:22.458323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bedfc6-66bf-4dd2-94f7-d89f73d223ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:22.459088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bedfc6-66bf-4dd2-94f7-d89f73d223ac admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:22.459532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bedfc6-66bf-4dd2-94f7-d89f73d223ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:22.469292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bedfc6-66bf-4dd2-94f7-d89f73d223ac admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:22.470659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bedfc6-66bf-4dd2-94f7-d89f73d223ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:22.477816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bedfc6-66bf-4dd2-94f7-d89f73d223ac admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:22.504785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 964/1943] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:22 2022] POST /identity/v3/users => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:22.509612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:22.511899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:22.535773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e2a07-ee29-496f-9db3-f91d4d00f923 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:22.543379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f36877-8b63-4741-982b-da30f3e6ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:22.544377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36877-8b63-4741-982b-da30f3e6ebcd admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:22.544893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36877-8b63-4741-982b-da30f3e6ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:22.545480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36877-8b63-4741-982b-da30f3e6ebcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:22.546689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f36877-8b63-4741-982b-da30f3e6ebcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:22.550499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f36877-8b63-4741-982b-da30f3e6ebcd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:22.570728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 980/1944] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:33:22.576335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bedfc6-66bf-4dd2-94f7-d89f73d223ac admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:22.598479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bedfc6-66bf-4dd2-94f7-d89f73d223ac admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:22.605685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4503d8-b140-4554-b144-7ba7392375e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:22.606408 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4503d8-b140-4554-b144-7ba7392375e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:22.606704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4503d8-b140-4554-b144-7ba7392375e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:22.606970 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4503d8-b140-4554-b144-7ba7392375e0 admin admin] PATH_INFO: `/v3/projects/d2636183c99f4767bc5408a6a64f34c4/users/e706c851fd414a40ad73036685f7e3c2/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:22.626524 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4503d8-b140-4554-b144-7ba7392375e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2636183c99f4767bc5408a6a64f34c4, user_id=e706c851fd414a40ad73036685f7e3c2, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:22.629747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4503d8-b140-4554-b144-7ba7392375e0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:22.646618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 965/1945] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:22 2022] PUT /identity/v3/projects/d2636183c99f4767bc5408a6a64f34c4/users/e706c851fd414a40ad73036685f7e3c2/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:22.650981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f36877-8b63-4741-982b-da30f3e6ebcd admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:22.664659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f36877-8b63-4741-982b-da30f3e6ebcd admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:22.772497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f9bc0-839b-441a-b610-2dc508acc4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:22.773495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f9bc0-839b-441a-b610-2dc508acc4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:22.773750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f9bc0-839b-441a-b610-2dc508acc4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:22.774067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f9bc0-839b-441a-b610-2dc508acc4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:22.774881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f9bc0-839b-441a-b610-2dc508acc4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:22.776846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f9bc0-839b-441a-b610-2dc508acc4e0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:22.793472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 981/1946] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:22.797314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4503d8-b140-4554-b144-7ba7392375e0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:22.812717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4503d8-b140-4554-b144-7ba7392375e0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:22.821811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:22.823109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:22.823779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:22.824129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] PATH_INFO: `/v3/projects/d2636183c99f4767bc5408a6a64f34c4/users/e706c851fd414a40ad73036685f7e3c2/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:22.828029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2636183c99f4767bc5408a6a64f34c4, user_id=e706c851fd414a40ad73036685f7e3c2, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:22.835054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:22.853020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 966/1947] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:22 2022] PUT /identity/v3/projects/d2636183c99f4767bc5408a6a64f34c4/users/e706c851fd414a40ad73036685f7e3c2/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:22.865094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084788d7-2ae9-4c1f-ac65-243c4d851d5f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:22.865395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084788d7-2ae9-4c1f-ac65-243c4d851d5f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:22.865671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084788d7-2ae9-4c1f-ac65-243c4d851d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:22.902081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-084788d7-2ae9-4c1f-ac65-243c4d851d5f None None] MFA Rules not processed for user `e706c851fd414a40ad73036685f7e3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:22.904737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-084788d7-2ae9-4c1f-ac65-243c4d851d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:22.953870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:22.956290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:23.048957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 982/1948] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:23.063724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084788d7-2ae9-4c1f-ac65-243c4d851d5f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:23.068899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-084788d7-2ae9-4c1f-ac65-243c4d851d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:23.077567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:23.099620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:23.119913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c31e88-4c72-4330-9286-f61e9019f514 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:23.129110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:23.130520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:23.133109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:23.133109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] PATH_INFO: `/v3/projects/52d7ce1aa5f04526832bfc1f1726252d` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:23.137097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d7ce1aa5f04526832bfc1f1726252d)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:23.143432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:23.194742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084788d7-2ae9-4c1f-ac65-243c4d851d5f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:23.206423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd86a8e-51f2-42a0-a218-61f76042a74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:23.206925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86a8e-51f2-42a0-a218-61f76042a74c service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:23.207203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86a8e-51f2-42a0-a218-61f76042a74c service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:23.207476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86a8e-51f2-42a0-a218-61f76042a74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:23.220823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd86a8e-51f2-42a0-a218-61f76042a74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:23.223441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd86a8e-51f2-42a0-a218-61f76042a74c service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:23.236346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 983/1949] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:23.313047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd86a8e-51f2-42a0-a218-61f76042a74c service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:23.316251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d7ce1aa5f04526832bfc1f1726252d', 'request_id': 'req-121560d4-6b6d-4ec0-a931-d84290f2baf0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:23.335788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd86a8e-51f2-42a0-a218-61f76042a74c service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:23.339594 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d7ce1aa5f04526832bfc1f1726252d', 'request_id': 'req-121560d4-6b6d-4ec0-a931-d84290f2baf0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:23.363424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d7ce1aa5f04526832bfc1f1726252d', 'request_id': 'req-121560d4-6b6d-4ec0-a931-d84290f2baf0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:23.389515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] The token cache is being invalidate because project 52d7ce1aa5f04526832bfc1f1726252d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:23.389893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:23.392945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-121560d4-6b6d-4ec0-a931-d84290f2baf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:23.395972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 967/1950] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:22 2022] DELETE /identity/v3/projects/52d7ce1aa5f04526832bfc1f1726252d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:23.400686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b9c7-65f4-449e-9e48-05e80c0b5353 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:23.401105 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b9c7-65f4-449e-9e48-05e80c0b5353 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:23.401449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b9c7-65f4-449e-9e48-05e80c0b5353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:23.452054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8913b9c7-65f4-449e-9e48-05e80c0b5353 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:23.454578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8913b9c7-65f4-449e-9e48-05e80c0b5353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:23.512124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:23.513721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:23.514837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:23.515895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:23.519615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:23.610874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 968/1951] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:23.619931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c014cc-fbad-4c1b-9395-a81507b4bd63 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:23.620436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c014cc-fbad-4c1b-9395-a81507b4bd63 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:23.621058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c014cc-fbad-4c1b-9395-a81507b4bd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:23.648083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:23.650169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:23.662414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 984/1952] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:23.675470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e5c014cc-fbad-4c1b-9395-a81507b4bd63 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:23.678173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e5c014cc-fbad-4c1b-9395-a81507b4bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:23.704639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 969/1953] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:23.709340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:23.727530 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba6459-60ba-4a4d-a197-258d474ac61f service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:23.733932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:23.734748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:23.735024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:23.735924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:23.737114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:23.737449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:23.739750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:23.763499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 985/1954] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:23.764726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c014cc-fbad-4c1b-9395-a81507b4bd63 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:23.808629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c014cc-fbad-4c1b-9395-a81507b4bd63 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:23.820074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874142c-6d90-4e1a-931b-e2ecdfad8bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:23.820074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874142c-6d90-4e1a-931b-e2ecdfad8bba admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:23.820376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874142c-6d90-4e1a-931b-e2ecdfad8bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:23.820647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874142c-6d90-4e1a-931b-e2ecdfad8bba admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:23.821313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874142c-6d90-4e1a-931b-e2ecdfad8bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:23.823499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874142c-6d90-4e1a-931b-e2ecdfad8bba admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:23.905696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 970/1955] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:23 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:23.914219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:23.941903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2934-472f-4766-9eff-5121afe2a040 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:24.050120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:24.076953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d6ed7-2bc4-428c-b87b-f8c0df76270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:24.077582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d6ed7-2bc4-428c-b87b-f8c0df76270b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.077794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d6ed7-2bc4-428c-b87b-f8c0df76270b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.078298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d6ed7-2bc4-428c-b87b-f8c0df76270b admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.079204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d6ed7-2bc4-428c-b87b-f8c0df76270b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:24.081555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d6ed7-2bc4-428c-b87b-f8c0df76270b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:24.131765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 986/1956] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:23 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:24.136901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874142c-6d90-4e1a-931b-e2ecdfad8bba admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:24.156213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874142c-6d90-4e1a-931b-e2ecdfad8bba admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:24.184180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b258fc0-4f2e-450d-9697-a6c4d1aeb65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:24.185262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258fc0-4f2e-450d-9697-a6c4d1aeb65a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.187378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258fc0-4f2e-450d-9697-a6c4d1aeb65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.192546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258fc0-4f2e-450d-9697-a6c4d1aeb65a admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.197291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b258fc0-4f2e-450d-9697-a6c4d1aeb65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:24.206856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b258fc0-4f2e-450d-9697-a6c4d1aeb65a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:24.249010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 971/1957] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:24.252261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d6ed7-2bc4-428c-b87b-f8c0df76270b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:24.287168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d6ed7-2bc4-428c-b87b-f8c0df76270b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:24.339859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195638da-2cb2-4354-b952-b6e7b746d8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:24.341281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195638da-2cb2-4354-b952-b6e7b746d8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.341763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195638da-2cb2-4354-b952-b6e7b746d8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.348649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195638da-2cb2-4354-b952-b6e7b746d8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.349543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195638da-2cb2-4354-b952-b6e7b746d8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:24.352210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195638da-2cb2-4354-b952-b6e7b746d8cb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:24.367357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 987/1958] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:24.371503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b258fc0-4f2e-450d-9697-a6c4d1aeb65a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:24.387718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b258fc0-4f2e-450d-9697-a6c4d1aeb65a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:24.396505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0446ef-676c-4d5b-b085-15ed605951f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:24.397669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0446ef-676c-4d5b-b085-15ed605951f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.398123 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0446ef-676c-4d5b-b085-15ed605951f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.398616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0446ef-676c-4d5b-b085-15ed605951f1 admin admin] PATH_INFO: `/v3/projects/84c0c30b175040af8d410a024fdeabaf/users/17eca655713d41a4b87c7a8efb1cf573/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.420850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0446ef-676c-4d5b-b085-15ed605951f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c0c30b175040af8d410a024fdeabaf, user_id=17eca655713d41a4b87c7a8efb1cf573, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:24.423528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0446ef-676c-4d5b-b085-15ed605951f1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:24.438999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 972/1959] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:24 2022] PUT /identity/v3/projects/84c0c30b175040af8d410a024fdeabaf/users/17eca655713d41a4b87c7a8efb1cf573/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:24.449985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1cbc4-930c-400e-a423-37eaa840631f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.450251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1cbc4-930c-400e-a423-37eaa840631f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.450521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1cbc4-930c-400e-a423-37eaa840631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.487250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a6d1cbc4-930c-400e-a423-37eaa840631f None None] MFA Rules not processed for user `17eca655713d41a4b87c7a8efb1cf573`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:24.488497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a6d1cbc4-930c-400e-a423-37eaa840631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:24.593914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 988/1960] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:24.595210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0446ef-676c-4d5b-b085-15ed605951f1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:24.626294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:24.682044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0446ef-676c-4d5b-b085-15ed605951f1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:24.694475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ce746-e777-49ef-9ef0-d1014bfdab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:24.695166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ce746-e777-49ef-9ef0-d1014bfdab35 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.695528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ce746-e777-49ef-9ef0-d1014bfdab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.695731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ce746-e777-49ef-9ef0-d1014bfdab35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.696408 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ce746-e777-49ef-9ef0-d1014bfdab35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:24.698706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ce746-e777-49ef-9ef0-d1014bfdab35 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:24.754015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 973/1961] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:24 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:24.756046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1cbc4-930c-400e-a423-37eaa840631f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:24.771282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1cbc4-930c-400e-a423-37eaa840631f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:24.857824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029b3ca-17cc-4e59-8aae-03545fd7ef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:24.858467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b3ca-17cc-4e59-8aae-03545fd7ef1e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.858744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b3ca-17cc-4e59-8aae-03545fd7ef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.859016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b3ca-17cc-4e59-8aae-03545fd7ef1e admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.859672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029b3ca-17cc-4e59-8aae-03545fd7ef1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:24.862640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029b3ca-17cc-4e59-8aae-03545fd7ef1e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:24.897905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 989/1962] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:24 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:24.902043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ce746-e777-49ef-9ef0-d1014bfdab35 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:24.914776 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ce746-e777-49ef-9ef0-d1014bfdab35 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:24.920212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00266113-0c53-444e-bfa1-afdf8f1d5de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:24.921089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266113-0c53-444e-bfa1-afdf8f1d5de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.921501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266113-0c53-444e-bfa1-afdf8f1d5de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.921867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00266113-0c53-444e-bfa1-afdf8f1d5de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.922874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00266113-0c53-444e-bfa1-afdf8f1d5de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:24.924804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00266113-0c53-444e-bfa1-afdf8f1d5de6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:24.938135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 974/1963] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:24.942677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029b3ca-17cc-4e59-8aae-03545fd7ef1e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:24.954757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029b3ca-17cc-4e59-8aae-03545fd7ef1e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:24.961089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b752c-18b1-46e6-9887-6cd1b7f5670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:24.961700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b752c-18b1-46e6-9887-6cd1b7f5670c admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:24.962052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b752c-18b1-46e6-9887-6cd1b7f5670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:24.962396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b752c-18b1-46e6-9887-6cd1b7f5670c admin admin] PATH_INFO: `/v3/projects/250f1a91d92d404a98548eb7a5a49134/users/614d3ed61dcb412998d1c050a02d2757/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:24.981796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b752c-18b1-46e6-9887-6cd1b7f5670c admin admin] RBAC: Authorizing `identity:create_grant(project_id=250f1a91d92d404a98548eb7a5a49134, user_id=614d3ed61dcb412998d1c050a02d2757, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:24.985122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b752c-18b1-46e6-9887-6cd1b7f5670c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:25.018580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 990/1964] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:24 2022] PUT /identity/v3/projects/250f1a91d92d404a98548eb7a5a49134/users/614d3ed61dcb412998d1c050a02d2757/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:25.024285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00266113-0c53-444e-bfa1-afdf8f1d5de6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:25.036634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00266113-0c53-444e-bfa1-afdf8f1d5de6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:25.127325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3561aa9-b823-4044-90e7-376f696e9866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:25.128136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561aa9-b823-4044-90e7-376f696e9866 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:25.128536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561aa9-b823-4044-90e7-376f696e9866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:25.129031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561aa9-b823-4044-90e7-376f696e9866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:25.130018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3561aa9-b823-4044-90e7-376f696e9866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:25.132449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3561aa9-b823-4044-90e7-376f696e9866 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:25.158642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 975/1965] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:25.160480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b752c-18b1-46e6-9887-6cd1b7f5670c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:25.193932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b752c-18b1-46e6-9887-6cd1b7f5670c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:25.193932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:25.193932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:25.194384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:25.194384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] PATH_INFO: `/v3/projects/250f1a91d92d404a98548eb7a5a49134/users/614d3ed61dcb412998d1c050a02d2757/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:25.198724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=250f1a91d92d404a98548eb7a5a49134, user_id=614d3ed61dcb412998d1c050a02d2757, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:25.201456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:25.218195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 991/1966] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:25 2022] PUT /identity/v3/projects/250f1a91d92d404a98548eb7a5a49134/users/614d3ed61dcb412998d1c050a02d2757/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:25.232362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa73f0-03f7-4c9d-94c8-3d1b50ab587d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:25.232928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa73f0-03f7-4c9d-94c8-3d1b50ab587d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:25.233412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa73f0-03f7-4c9d-94c8-3d1b50ab587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:25.281628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b7fa73f0-03f7-4c9d-94c8-3d1b50ab587d None None] MFA Rules not processed for user `614d3ed61dcb412998d1c050a02d2757`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:25.283797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b7fa73f0-03f7-4c9d-94c8-3d1b50ab587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:25.506782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 976/1967] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:25.544767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:25.546865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:25.561367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:25.649767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a64aa4-20c1-4c2e-9519-013df5cb6e92 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:25.662148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:25.664511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:25.666467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:25.666467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:25.686405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:25.688469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:25.708513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 992/1968] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:25.785122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa73f0-03f7-4c9d-94c8-3d1b50ab587d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:25.786899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b7fa73f0-03f7-4c9d-94c8-3d1b50ab587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:25.801991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa73f0-03f7-4c9d-94c8-3d1b50ab587d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:25.806665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68dad8-4f13-440b-9e0f-644c7aead800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:25.807427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68dad8-4f13-440b-9e0f-644c7aead800 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:25.807804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68dad8-4f13-440b-9e0f-644c7aead800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:25.808166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68dad8-4f13-440b-9e0f-644c7aead800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:25.820322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:25.902339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68dad8-4f13-440b-9e0f-644c7aead800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:25.904867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68dad8-4f13-440b-9e0f-644c7aead800 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:25.932754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 977/1969] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:29.342481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:29.344049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:29.454359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc79d-6dfd-4384-a0c0-bedcdf49b6b9 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:29.466139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:29.466139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:29.466139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:29.466502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] PATH_INFO: `/v3/users/e7e7d5e228ff40ee91cbd434fd96575b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:29.468991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e7d5e228ff40ee91cbd434fd96575b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:29.471343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:29.578110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e7d5e228ff40ee91cbd434fd96575b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:29.605754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e7d5e228ff40ee91cbd434fd96575b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:29.617721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e7d5e228ff40ee91cbd434fd96575b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:29.619305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e7d5e228ff40ee91cbd434fd96575b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:29.633523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e7d5e228ff40ee91cbd434fd96575b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:29.654551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 993/1970] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:29 2022] DELETE /identity/v3/users/e7e7d5e228ff40ee91cbd434fd96575b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:29.656743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e071c-b10e-4b8c-80ba-a7a7da472344 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:29.657638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e071c-b10e-4b8c-80ba-a7a7da472344 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:29.658176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e071c-b10e-4b8c-80ba-a7a7da472344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:29.681770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dd1e071c-b10e-4b8c-80ba-a7a7da472344 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:29.683219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dd1e071c-b10e-4b8c-80ba-a7a7da472344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:29.778592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 978/1971] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:29.875660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:29.877903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:29.938822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:30.008831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d0640-d766-4a13-bb86-25c4ace28c12 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:30.020097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:30.020770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:30.021045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:30.021311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:30.036377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:30.037923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:30.060765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 994/1972] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:30.993465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e071c-b10e-4b8c-80ba-a7a7da472344 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:30.995716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dd1e071c-b10e-4b8c-80ba-a7a7da472344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:31.018778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e071c-b10e-4b8c-80ba-a7a7da472344 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:31.026548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:31.027641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:31.028430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:31.028965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] PATH_INFO: `/v3/projects/12ce486f01484b02bd459d6ebb6f6c8b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:31.030732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ce486f01484b02bd459d6ebb6f6c8b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:31.035127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:31.041961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:31.045353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:31.079555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb68077-c804-41a2-a392-a02ba6ca92f7 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:31.086266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:31.086973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:31.087255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:31.087593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] PATH_INFO: `/v3/users/17eca655713d41a4b87c7a8efb1cf573` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:31.089157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17eca655713d41a4b87c7a8efb1cf573)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:31.091172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:31.116346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ce486f01484b02bd459d6ebb6f6c8b', 'request_id': 'req-799e3f92-05a2-4934-b6ac-d0057e18b2c6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.132802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ce486f01484b02bd459d6ebb6f6c8b', 'request_id': 'req-799e3f92-05a2-4934-b6ac-d0057e18b2c6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.149384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ce486f01484b02bd459d6ebb6f6c8b', 'request_id': 'req-799e3f92-05a2-4934-b6ac-d0057e18b2c6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.174819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] The token cache is being invalidate because project 12ce486f01484b02bd459d6ebb6f6c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:31.174819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.175451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.182898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 979/1973] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:30 2022] DELETE /identity/v3/projects/12ce486f01484b02bd459d6ebb6f6c8b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:31.184303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:31.191132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:31.205487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17eca655713d41a4b87c7a8efb1cf573'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.237609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17eca655713d41a4b87c7a8efb1cf573'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.262176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:31.267147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17eca655713d41a4b87c7a8efb1cf573'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.269036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17eca655713d41a4b87c7a8efb1cf573'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.269713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c3ebb85-09e7-4eea-aaab-baf6fdc2a285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17eca655713d41a4b87c7a8efb1cf573'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.301012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 995/1974] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:31 2022] DELETE /identity/v3/users/17eca655713d41a4b87c7a8efb1cf573 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:31.321302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1f06-84c6-4858-b16d-b6524372e059 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:31.322849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1f06-84c6-4858-b16d-b6524372e059 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:31.324422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1f06-84c6-4858-b16d-b6524372e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:31.340982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3f92-05a2-4934-b6ac-d0057e18b2c6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:31.352228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d13f1f06-84c6-4858-b16d-b6524372e059 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:31.353885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d13f1f06-84c6-4858-b16d-b6524372e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:31.458204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:31.459631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:31.460045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:31.461492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] PATH_INFO: `/v3/users/e706c851fd414a40ad73036685f7e3c2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:31.463055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e706c851fd414a40ad73036685f7e3c2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:31.488121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:31.493635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 996/1975] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:31.557925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f1f06-84c6-4858-b16d-b6524372e059 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:31.559582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d13f1f06-84c6-4858-b16d-b6524372e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:31.585204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e706c851fd414a40ad73036685f7e3c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.604687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e706c851fd414a40ad73036685f7e3c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.605703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e706c851fd414a40ad73036685f7e3c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.606567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e706c851fd414a40ad73036685f7e3c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.622278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e706c851fd414a40ad73036685f7e3c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:31.655604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 980/1976] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:31 2022] DELETE /identity/v3/users/e706c851fd414a40ad73036685f7e3c2 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:31.661810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:31.675738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f1f06-84c6-4858-b16d-b6524372e059 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:31.735358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:31.736332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:31.736985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:31.737514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:31.739536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:31.866399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:31.868199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:31.882634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 997/1977] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:33:32.557547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:32.559371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:32.577652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad6b9-4eae-463e-8805-4edac99991d8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:32.584700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:32.585805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:32.586276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:32.586855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] PATH_INFO: `/v3/projects/d2636183c99f4767bc5408a6a64f34c4` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:32.588835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2636183c99f4767bc5408a6a64f34c4)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:32.591505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:32.682811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:32.685609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:32.706972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866518d-1220-4c57-9155-6af7579d8c1b service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:32.710102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2636183c99f4767bc5408a6a64f34c4', 'request_id': 'req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:32.729083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2636183c99f4767bc5408a6a64f34c4', 'request_id': 'req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:32.739702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:32.748789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2636183c99f4767bc5408a6a64f34c4', 'request_id': 'req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:32.784047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] The token cache is being invalidate because project d2636183c99f4767bc5408a6a64f34c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:32.784671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:32.785610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9b795f1f-68ed-4f4f-bc91-afeaf5600cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:32.789308 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 981/1978] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:32 2022] DELETE /identity/v3/projects/d2636183c99f4767bc5408a6a64f34c4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:32.800953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83151cb-0821-4918-bdb7-4cb708af8975 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:32.801923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83151cb-0821-4918-bdb7-4cb708af8975 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:32.803088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83151cb-0821-4918-bdb7-4cb708af8975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:32.844599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:32.847271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:32.847944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:32.848539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] PATH_INFO: `/v3/projects/84c0c30b175040af8d410a024fdeabaf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:32.850086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c0c30b175040af8d410a024fdeabaf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:32.852630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:32.869443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d83151cb-0821-4918-bdb7-4cb708af8975 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:32.872328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d83151cb-0821-4918-bdb7-4cb708af8975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:32.888990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 982/1979] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:32.902939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed678e-8e02-4cbf-8910-3c22d6505f2f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:32.903460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed678e-8e02-4cbf-8910-3c22d6505f2f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:32.903909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed678e-8e02-4cbf-8910-3c22d6505f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:32.945497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2fed678e-8e02-4cbf-8910-3c22d6505f2f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:32.946857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2fed678e-8e02-4cbf-8910-3c22d6505f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:32.976723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c0c30b175040af8d410a024fdeabaf', 'request_id': 'req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:32.983132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:32.992917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c0c30b175040af8d410a024fdeabaf', 'request_id': 'req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.013620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c0c30b175040af8d410a024fdeabaf', 'request_id': 'req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.031043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] The token cache is being invalidate because project 84c0c30b175040af8d410a024fdeabaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:33.031778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.032675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.034544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 998/1980] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:32 2022] DELETE /identity/v3/projects/84c0c30b175040af8d410a024fdeabaf => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:33.039787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 983/1981] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:33.041144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.041332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed678e-8e02-4cbf-8910-3c22d6505f2f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.042818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:33.051316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed678e-8e02-4cbf-8910-3c22d6505f2f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.056618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa6a21-f8bf-45e1-bb11-5bccc6ffe06a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.057504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.058218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.058557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.058841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.059515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:33.059822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.061744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:33.065558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.066546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.066940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.067484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] PATH_INFO: `/v3/users/614d3ed61dcb412998d1c050a02d2757` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.069995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614d3ed61dcb412998d1c050a02d2757)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.072795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:33.082427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 984/1982] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:33.087912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.091267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:33.118851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292405b7-2d72-445d-9527-3e5851bad41b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.124836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f9cd-6781-4d2a-836d-564df25b11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.125542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f9cd-6781-4d2a-836d-564df25b11d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.125825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f9cd-6781-4d2a-836d-564df25b11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.126134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f9cd-6781-4d2a-836d-564df25b11d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.126969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249f9cd-6781-4d2a-836d-564df25b11d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.129386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249f9cd-6781-4d2a-836d-564df25b11d9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:33.157615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614d3ed61dcb412998d1c050a02d2757'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.169520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 985/1983] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:33 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:33.171020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f9cd-6781-4d2a-836d-564df25b11d9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.176575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614d3ed61dcb412998d1c050a02d2757'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.188365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614d3ed61dcb412998d1c050a02d2757'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.190855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614d3ed61dcb412998d1c050a02d2757'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.191807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614d3ed61dcb412998d1c050a02d2757'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.208756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 999/1984] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:33 2022] DELETE /identity/v3/users/614d3ed61dcb412998d1c050a02d2757 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:33.257555 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f9cd-6781-4d2a-836d-564df25b11d9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.341739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:33.366795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbe5d-474f-4616-9d0d-7ef44a2b4cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.366795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbe5d-474f-4616-9d0d-7ef44a2b4cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.367247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbe5d-474f-4616-9d0d-7ef44a2b4cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.367247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbe5d-474f-4616-9d0d-7ef44a2b4cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.367866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cbe5d-474f-4616-9d0d-7ef44a2b4cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.370791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cbe5d-474f-4616-9d0d-7ef44a2b4cf8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:33.401491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 986/1985] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:33 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:33:33.407512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.412299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:33.435205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe6f9c-240d-49e9-9bb1-c21fd0b1f7a2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.443834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe002e-9dc1-4e10-b99c-403b7d81d2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.444534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe002e-9dc1-4e10-b99c-403b7d81d2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.444815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe002e-9dc1-4e10-b99c-403b7d81d2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.445089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe002e-9dc1-4e10-b99c-403b7d81d2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.446723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe002e-9dc1-4e10-b99c-403b7d81d2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.447678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe002e-9dc1-4e10-b99c-403b7d81d2cb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:33.475770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1000/1986] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:33:33.476175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbe5d-474f-4616-9d0d-7ef44a2b4cf8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.495932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbe5d-474f-4616-9d0d-7ef44a2b4cf8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.507326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.509558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.510318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.511092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.512906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.516565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:33.582594 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 987/1987] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:33:33.588644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe002e-9dc1-4e10-b99c-403b7d81d2cb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.613915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.617423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:33.623406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe002e-9dc1-4e10-b99c-403b7d81d2cb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.652968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.653805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.654088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.657594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] PATH_INFO: `/v3/projects/98088b8573d74fa4b3b84b5b18c61576/users/c0f1a7d559aa49d4a389ea819370a522/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.684101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772f82c-27af-42f6-b440-e2f38a6aa4a9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.695959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.696672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.696963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.697304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] PATH_INFO: `/v3/users/fa40badfd3264acc962ae74d9688e452` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.701607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa40badfd3264acc962ae74d9688e452)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.703708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:33.709628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98088b8573d74fa4b3b84b5b18c61576, user_id=c0f1a7d559aa49d4a389ea819370a522, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.712410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:33.756493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1001/1988] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:33 2022] PUT /identity/v3/projects/98088b8573d74fa4b3b84b5b18c61576/users/c0f1a7d559aa49d4a389ea819370a522/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:33.757449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:33.760991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:33.887050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa40badfd3264acc962ae74d9688e452'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.906968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa40badfd3264acc962ae74d9688e452'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.908560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa40badfd3264acc962ae74d9688e452'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.910320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa40badfd3264acc962ae74d9688e452'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.928064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-98accf1e-0ef4-4092-8cfe-ff271e9f67d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa40badfd3264acc962ae74d9688e452'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:33.958432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598278b-d250-4cbd-91b1-655607e68898 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:33.975064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 988/1989] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:33 2022] DELETE /identity/v3/users/fa40badfd3264acc962ae74d9688e452 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:33.977551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:33.978396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.978679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.978945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] PATH_INFO: `/v3/projects/250f1a91d92d404a98548eb7a5a49134` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.979725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcb938-789e-4d3f-aeda-fc28930354de None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:33.980072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcb938-789e-4d3f-aeda-fc28930354de None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:33.980328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcb938-789e-4d3f-aeda-fc28930354de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:33.983115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=250f1a91d92d404a98548eb7a5a49134)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:33.987247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:34.054254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:34.073622 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-54dcb938-789e-4d3f-aeda-fc28930354de None None] MFA Rules not processed for user `c0f1a7d559aa49d4a389ea819370a522`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:34.075144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-54dcb938-789e-4d3f-aeda-fc28930354de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:34.141467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '250f1a91d92d404a98548eb7a5a49134', 'request_id': 'req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:34.181922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '250f1a91d92d404a98548eb7a5a49134', 'request_id': 'req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:34.197147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '250f1a91d92d404a98548eb7a5a49134', 'request_id': 'req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:34.222605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] The token cache is being invalidate because project 250f1a91d92d404a98548eb7a5a49134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:34.222902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:34.224808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-09082a94-5f9f-4ba3-b914-c8d1e4732dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:34.230316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1002/1990] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:33 2022] DELETE /identity/v3/projects/250f1a91d92d404a98548eb7a5a49134 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:34.233604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c9df5-5928-4c27-ad25-b58f5d5efe41 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.235188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c9df5-5928-4c27-ad25-b58f5d5efe41 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.235741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c9df5-5928-4c27-ad25-b58f5d5efe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.246232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 989/1991] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:34.247930 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c74e4-c9bb-44aa-932c-0491ad601821 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.248428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c74e4-c9bb-44aa-932c-0491ad601821 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.248882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c74e4-c9bb-44aa-932c-0491ad601821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.284916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1a7c74e4-c9bb-44aa-932c-0491ad601821 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:34.286997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8a7c9df5-5928-4c27-ad25-b58f5d5efe41 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:34.288372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8a7c9df5-5928-4c27-ad25-b58f5d5efe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:34.290600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1a7c74e4-c9bb-44aa-932c-0491ad601821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:34.354961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:34.392422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1003/1992] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:34.393226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c9df5-5928-4c27-ad25-b58f5d5efe41 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.394819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8a7c9df5-5928-4c27-ad25-b58f5d5efe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:34.413563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c9df5-5928-4c27-ad25-b58f5d5efe41 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:34.419890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d65168-e4d9-482d-a777-47512b07c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:34.420578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d65168-e4d9-482d-a777-47512b07c39f admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.420864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d65168-e4d9-482d-a777-47512b07c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.421136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d65168-e4d9-482d-a777-47512b07c39f admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.421826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d65168-e4d9-482d-a777-47512b07c39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:34.423960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d65168-e4d9-482d-a777-47512b07c39f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:34.445024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 990/1993] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:34.446397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c74e4-c9bb-44aa-932c-0491ad601821 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.448211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1a7c74e4-c9bb-44aa-932c-0491ad601821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:34.485038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1004/1994] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:34 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:34.486941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef65f-4066-4b31-834f-1cb3ad8bfe59 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.487113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef65f-4066-4b31-834f-1cb3ad8bfe59 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.487381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef65f-4066-4b31-834f-1cb3ad8bfe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.514887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-485ef65f-4066-4b31-834f-1cb3ad8bfe59 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:34.516215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-485ef65f-4066-4b31-834f-1cb3ad8bfe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:34.560070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c74e4-c9bb-44aa-932c-0491ad601821 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:34.654648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1005/1995] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:34.654648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ef65f-4066-4b31-834f-1cb3ad8bfe59 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.662289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d1800-06a0-4aa9-aa98-fe103a90d5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:34.663165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d1800-06a0-4aa9-aa98-fe103a90d5bf service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.663437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d1800-06a0-4aa9-aa98-fe103a90d5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.663812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d1800-06a0-4aa9-aa98-fe103a90d5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.670024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ef65f-4066-4b31-834f-1cb3ad8bfe59 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:34.677286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d1800-06a0-4aa9-aa98-fe103a90d5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:34.679661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d1800-06a0-4aa9-aa98-fe103a90d5bf service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:34.679870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfbae7-33c3-4d4f-9433-348c0626b238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:34.680791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfbae7-33c3-4d4f-9433-348c0626b238 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.681300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfbae7-33c3-4d4f-9433-348c0626b238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.681881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfbae7-33c3-4d4f-9433-348c0626b238 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.683333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfbae7-33c3-4d4f-9433-348c0626b238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:34.687269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfbae7-33c3-4d4f-9433-348c0626b238 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:34.697965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 991/1996] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:34.699615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d1800-06a0-4aa9-aa98-fe103a90d5bf service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.716743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d1800-06a0-4aa9-aa98-fe103a90d5bf service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:34.724875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:34.726074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.726473 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.727835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.729204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:34.729886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:34.732812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:34.758465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1006/1997] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:34 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:34.760582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfbae7-33c3-4d4f-9433-348c0626b238 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.766805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 992/1998] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:34.770472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.794603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfbae7-33c3-4d4f-9433-348c0626b238 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:34.795763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc549-cedd-4e6a-8c0b-c38c3b63d271 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:34.806826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016ba6-6575-4f03-a9b5-05c1a94965c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:34.807680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbdbe4-2a23-496a-b5ae-17fcf20676e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:34.807907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016ba6-6575-4f03-a9b5-05c1a94965c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.808369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016ba6-6575-4f03-a9b5-05c1a94965c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.808818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbdbe4-2a23-496a-b5ae-17fcf20676e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.809092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016ba6-6575-4f03-a9b5-05c1a94965c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.809300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbdbe4-2a23-496a-b5ae-17fcf20676e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.809764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbdbe4-2a23-496a-b5ae-17fcf20676e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.810310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016ba6-6575-4f03-a9b5-05c1a94965c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:34.811440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbdbe4-2a23-496a-b5ae-17fcf20676e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:34.814063 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbdbe4-2a23-496a-b5ae-17fcf20676e1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:34.816418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016ba6-6575-4f03-a9b5-05c1a94965c0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:34.819074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:34.836221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1007/1999] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:34.843114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbdbe4-2a23-496a-b5ae-17fcf20676e1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.870420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbdbe4-2a23-496a-b5ae-17fcf20676e1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:34.878982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971beb20-3591-402d-8bd1-02fe7a290b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:34.880182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971beb20-3591-402d-8bd1-02fe7a290b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:34.880714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971beb20-3591-402d-8bd1-02fe7a290b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:34.881188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971beb20-3591-402d-8bd1-02fe7a290b4c admin admin] PATH_INFO: `/v3/projects/73542d7a66694441abf9f4f0cf04602c/users/4348537c36ff475cafec11a657af7045/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:34.884304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 993/2000] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:34 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:34.885904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016ba6-6575-4f03-a9b5-05c1a94965c0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.911577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971beb20-3591-402d-8bd1-02fe7a290b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73542d7a66694441abf9f4f0cf04602c, user_id=4348537c36ff475cafec11a657af7045, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:34.914838 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971beb20-3591-402d-8bd1-02fe7a290b4c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:34.936874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1008/2001] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:34 2022] PUT /identity/v3/projects/73542d7a66694441abf9f4f0cf04602c/users/4348537c36ff475cafec11a657af7045/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:34.949521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971beb20-3591-402d-8bd1-02fe7a290b4c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:34.995811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:35.011233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016ba6-6575-4f03-a9b5-05c1a94965c0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:35.078246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971beb20-3591-402d-8bd1-02fe7a290b4c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:35.117508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9182-4bd1-403f-a636-8c891bab4bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:35.118140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9182-4bd1-403f-a636-8c891bab4bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.118414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9182-4bd1-403f-a636-8c891bab4bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.118682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9182-4bd1-403f-a636-8c891bab4bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.119329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9182-4bd1-403f-a636-8c891bab4bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:35.123251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9182-4bd1-403f-a636-8c891bab4bbb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:35.132368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea296a80-c70d-4a2d-bf18-c67ef5972da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:35.133822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296a80-c70d-4a2d-bf18-c67ef5972da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.134561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296a80-c70d-4a2d-bf18-c67ef5972da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.137777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea296a80-c70d-4a2d-bf18-c67ef5972da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.139494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea296a80-c70d-4a2d-bf18-c67ef5972da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:35.141893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1009/2002] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:35.144317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea296a80-c70d-4a2d-bf18-c67ef5972da4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:35.148593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9182-4bd1-403f-a636-8c891bab4bbb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:35.165331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9182-4bd1-403f-a636-8c891bab4bbb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:35.185768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea821fa-727a-4fb1-b9d2-e45977f093ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:35.186921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea821fa-727a-4fb1-b9d2-e45977f093ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.187562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea821fa-727a-4fb1-b9d2-e45977f093ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.188074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea821fa-727a-4fb1-b9d2-e45977f093ac admin admin] PATH_INFO: `/v3/projects/73542d7a66694441abf9f4f0cf04602c/users/4348537c36ff475cafec11a657af7045/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.194617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea821fa-727a-4fb1-b9d2-e45977f093ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=73542d7a66694441abf9f4f0cf04602c, user_id=4348537c36ff475cafec11a657af7045, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:35.200822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea821fa-727a-4fb1-b9d2-e45977f093ac admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:35.207472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 994/2003] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:34 2022] POST /identity/v3/users => generated 290 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:35.214216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea296a80-c70d-4a2d-bf18-c67ef5972da4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:35.224514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1010/2004] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:35 2022] PUT /identity/v3/projects/73542d7a66694441abf9f4f0cf04602c/users/4348537c36ff475cafec11a657af7045/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:35.238751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69508-f81f-459a-b3d5-a0f8fb1e11cc None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.243371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69508-f81f-459a-b3d5-a0f8fb1e11cc None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.244164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69508-f81f-459a-b3d5-a0f8fb1e11cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.250699 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea296a80-c70d-4a2d-bf18-c67ef5972da4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:35.347564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c9b69508-f81f-459a-b3d5-a0f8fb1e11cc None None] MFA Rules not processed for user `4348537c36ff475cafec11a657af7045`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:35.349640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c9b69508-f81f-459a-b3d5-a0f8fb1e11cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:35.417537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:35.418656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.419165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.420109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.421441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:35.425196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:35.457055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 995/2005] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:33:35.459868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:35.477521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:35.498167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018a2e0-f5e4-4b02-bdf1-d7802b517197 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:35.503278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:35.503935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.504214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.504552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] PATH_INFO: `/v3/projects/e7b161e06fa7483c8bb9d8d6b9840b06` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.505777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b161e06fa7483c8bb9d8d6b9840b06)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:35.507720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:35.524790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1011/2006] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:35.524790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69508-f81f-459a-b3d5-a0f8fb1e11cc None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:35.534595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69508-f81f-459a-b3d5-a0f8fb1e11cc None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:35.539801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:35.540561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.540880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.541149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.541797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:35.543502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:35.556851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1012/2007] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:35.557746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:35.559631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:35.580640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b161e06fa7483c8bb9d8d6b9840b06', 'request_id': 'req-a46ecb1f-e130-403e-b0cf-fd8992036f9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:35.589266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b161e06fa7483c8bb9d8d6b9840b06', 'request_id': 'req-a46ecb1f-e130-403e-b0cf-fd8992036f9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:35.599191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:35.599827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b161e06fa7483c8bb9d8d6b9840b06', 'request_id': 'req-a46ecb1f-e130-403e-b0cf-fd8992036f9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:35.613367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] The token cache is being invalidate because project e7b161e06fa7483c8bb9d8d6b9840b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:35.613769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:35.614543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:35.616185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 996/2008] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:35 2022] DELETE /identity/v3/projects/e7b161e06fa7483c8bb9d8d6b9840b06 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:35.617142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:35.618619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:35.636323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89656813-0a6c-493b-b1b3-0ac4bed17a2c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:35.642371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:35.726369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864098da-dbbf-4769-84b8-77129060887f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:35.727881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864098da-dbbf-4769-84b8-77129060887f service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.728405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864098da-dbbf-4769-84b8-77129060887f service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.728963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864098da-dbbf-4769-84b8-77129060887f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.732319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-864098da-dbbf-4769-84b8-77129060887f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:35.769730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ecb1f-e130-403e-b0cf-fd8992036f9c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:35.786389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f0ca7-5f1f-4d61-81b0-4d40d238851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:35.788230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0ca7-5f1f-4d61-81b0-4d40d238851d admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.788756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0ca7-5f1f-4d61-81b0-4d40d238851d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.790059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0ca7-5f1f-4d61-81b0-4d40d238851d admin admin] PATH_INFO: `/v3/projects/298ff6648f644087b944e9224dc888b7/users/20b63399749441b7bd0401ae2fc89f6d/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.829035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f0ca7-5f1f-4d61-81b0-4d40d238851d admin admin] RBAC: Authorizing `identity:create_grant(project_id=298ff6648f644087b944e9224dc888b7, user_id=20b63399749441b7bd0401ae2fc89f6d, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:35.836340 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f0ca7-5f1f-4d61-81b0-4d40d238851d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:35.860253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 997/2009] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:35 2022] PUT /identity/v3/projects/298ff6648f644087b944e9224dc888b7/users/20b63399749441b7bd0401ae2fc89f6d/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:35.863041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886f6b-a81f-4fa8-8a49-01304cb6a867 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.863542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886f6b-a81f-4fa8-8a49-01304cb6a867 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.863984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886f6b-a81f-4fa8-8a49-01304cb6a867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.867568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864098da-dbbf-4769-84b8-77129060887f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:35.870459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864098da-dbbf-4769-84b8-77129060887f service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:35.890178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1013/2010] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:35.891906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7b886f6b-a81f-4fa8-8a49-01304cb6a867 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:35.893324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6703d-7167-4556-864f-d683fedb225f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:35.893592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6703d-7167-4556-864f-d683fedb225f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:35.893828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7b886f6b-a81f-4fa8-8a49-01304cb6a867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:35.894066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6703d-7167-4556-864f-d683fedb225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:35.965781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-cdf6703d-7167-4556-864f-d683fedb225f None None] MFA Rules not processed for user `20b63399749441b7bd0401ae2fc89f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:35.968876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cdf6703d-7167-4556-864f-d683fedb225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:36.051587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 998/2011] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:36.054120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5287-1f0a-4ea4-8aac-dfa3ba841da2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.054463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5287-1f0a-4ea4-8aac-dfa3ba841da2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.054735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5287-1f0a-4ea4-8aac-dfa3ba841da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.080747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8adc5287-1f0a-4ea4-8aac-dfa3ba841da2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:36.081647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8adc5287-1f0a-4ea4-8aac-dfa3ba841da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:36.093032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 999/2012] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:36.098159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5287-1f0a-4ea4-8aac-dfa3ba841da2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.111688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5287-1f0a-4ea4-8aac-dfa3ba841da2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.122215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.123960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.124598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.125076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.126218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:36.126972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.130254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.133145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1014/2013] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:36.134982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6703d-7167-4556-864f-d683fedb225f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.152781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6703d-7167-4556-864f-d683fedb225f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.153609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1000/2014] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:33:36.159844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.169288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b55402-e29e-41ca-9d8c-c3bf13a3908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.169976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b55402-e29e-41ca-9d8c-c3bf13a3908f admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.170329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b55402-e29e-41ca-9d8c-c3bf13a3908f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.170511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b55402-e29e-41ca-9d8c-c3bf13a3908f admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.171336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b55402-e29e-41ca-9d8c-c3bf13a3908f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.173440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b55402-e29e-41ca-9d8c-c3bf13a3908f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.182934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c34ac-281d-4676-9c4a-c3b4690da074 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.191704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecb306-af52-4ead-8a84-8567733e9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.192354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecb306-af52-4ead-8a84-8567733e9e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.192762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecb306-af52-4ead-8a84-8567733e9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.193046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecb306-af52-4ead-8a84-8567733e9e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.193775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecb306-af52-4ead-8a84-8567733e9e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.195995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecb306-af52-4ead-8a84-8567733e9e43 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.232686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1015/2015] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:36 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:36.235140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b55402-e29e-41ca-9d8c-c3bf13a3908f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.248896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:36.251008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1001/2016] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:36 2022] POST /identity/v3/projects => generated 397 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:36.258327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecb306-af52-4ead-8a84-8567733e9e43 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.335067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b55402-e29e-41ca-9d8c-c3bf13a3908f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.366595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:36.383840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecb306-af52-4ead-8a84-8567733e9e43 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.394154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac643860-2cd7-41d9-89e8-597cf65c3cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.394814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac643860-2cd7-41d9-89e8-597cf65c3cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.396252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac643860-2cd7-41d9-89e8-597cf65c3cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.396714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac643860-2cd7-41d9-89e8-597cf65c3cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.397394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac643860-2cd7-41d9-89e8-597cf65c3cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.400242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac643860-2cd7-41d9-89e8-597cf65c3cc0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.431390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048cc8f-8fb6-4d1c-aae2-85e30d059999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.432065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048cc8f-8fb6-4d1c-aae2-85e30d059999 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.432322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048cc8f-8fb6-4d1c-aae2-85e30d059999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.432624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048cc8f-8fb6-4d1c-aae2-85e30d059999 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.435524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048cc8f-8fb6-4d1c-aae2-85e30d059999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.436234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1002/2017] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:36 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:33:36.437625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048cc8f-8fb6-4d1c-aae2-85e30d059999 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.441432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac643860-2cd7-41d9-89e8-597cf65c3cc0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.469198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac643860-2cd7-41d9-89e8-597cf65c3cc0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.479623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1016/2018] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:36 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:36.484230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048cc8f-8fb6-4d1c-aae2-85e30d059999 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.486668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012f1a9-45b2-4a56-a46e-a929f2875c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.503960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048cc8f-8fb6-4d1c-aae2-85e30d059999 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.504638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012f1a9-45b2-4a56-a46e-a929f2875c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.505169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012f1a9-45b2-4a56-a46e-a929f2875c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.505472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012f1a9-45b2-4a56-a46e-a929f2875c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.506149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012f1a9-45b2-4a56-a46e-a929f2875c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.511070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a471f4d-b1a2-4eea-b15e-261ddbccd196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.511854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471f4d-b1a2-4eea-b15e-261ddbccd196 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.512354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471f4d-b1a2-4eea-b15e-261ddbccd196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.512760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471f4d-b1a2-4eea-b15e-261ddbccd196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.513535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a471f4d-b1a2-4eea-b15e-261ddbccd196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.515699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a471f4d-b1a2-4eea-b15e-261ddbccd196 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.524806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012f1a9-45b2-4a56-a46e-a929f2875c93 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.534063 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1017/2019] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:33:36.547316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a471f4d-b1a2-4eea-b15e-261ddbccd196 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.572218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1003/2020] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:36.572462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012f1a9-45b2-4a56-a46e-a929f2875c93 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.573446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a471f4d-b1a2-4eea-b15e-261ddbccd196 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.586812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13155689-2443-40d9-9922-328fb847e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.590533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13155689-2443-40d9-9922-328fb847e1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.590967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13155689-2443-40d9-9922-328fb847e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.591388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13155689-2443-40d9-9922-328fb847e1a3 admin admin] PATH_INFO: `/v3/projects/1c90fdf89f9249748dbc00fc63bbd775/users/ca10bb37957e43efb7cf40b14f374d18/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.602204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012f1a9-45b2-4a56-a46e-a929f2875c93 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.609178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eb391-7a6b-4bea-b8ea-13643efe875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.609511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eb391-7a6b-4bea-b8ea-13643efe875e admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.609888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eb391-7a6b-4bea-b8ea-13643efe875e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.610396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eb391-7a6b-4bea-b8ea-13643efe875e admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.612879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eb391-7a6b-4bea-b8ea-13643efe875e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.617569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524eb391-7a6b-4bea-b8ea-13643efe875e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.619909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13155689-2443-40d9-9922-328fb847e1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c90fdf89f9249748dbc00fc63bbd775, user_id=ca10bb37957e43efb7cf40b14f374d18, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.624847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13155689-2443-40d9-9922-328fb847e1a3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.645320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1004/2021] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:36.650051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eb391-7a6b-4bea-b8ea-13643efe875e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.654965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1018/2022] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:36 2022] PUT /identity/v3/projects/1c90fdf89f9249748dbc00fc63bbd775/users/ca10bb37957e43efb7cf40b14f374d18/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:36.659539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13155689-2443-40d9-9922-328fb847e1a3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.675673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eb391-7a6b-4bea-b8ea-13643efe875e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.853759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d4b61-caf7-4a68-87b5-5df1c1354860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.855421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4b61-caf7-4a68-87b5-5df1c1354860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.855898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4b61-caf7-4a68-87b5-5df1c1354860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.856528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4b61-caf7-4a68-87b5-5df1c1354860 admin admin] PATH_INFO: `/v3/projects/e930ab73023542c7bceff694b13a5896/users/b9c294dcd2b04859950da5c07f448640/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.882350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13155689-2443-40d9-9922-328fb847e1a3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:36.893748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230713-51ea-4949-9104-e6b887cc1929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:36.896451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230713-51ea-4949-9104-e6b887cc1929 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.897226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230713-51ea-4949-9104-e6b887cc1929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.898569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230713-51ea-4949-9104-e6b887cc1929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.900115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45230713-51ea-4949-9104-e6b887cc1929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.902725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d4b61-caf7-4a68-87b5-5df1c1354860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e930ab73023542c7bceff694b13a5896, user_id=b9c294dcd2b04859950da5c07f448640, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:36.906166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45230713-51ea-4949-9104-e6b887cc1929 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.909546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d4b61-caf7-4a68-87b5-5df1c1354860 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:36.938802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1019/2023] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:33:36.945986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1005/2024] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:36 2022] PUT /identity/v3/projects/e930ab73023542c7bceff694b13a5896/users/b9c294dcd2b04859950da5c07f448640/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:36.949394 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230713-51ea-4949-9104-e6b887cc1929 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:36.970232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142f9c-48ca-4c3a-b6aa-fc4de63361e3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:36.970830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142f9c-48ca-4c3a-b6aa-fc4de63361e3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:36.971517 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:36.971906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142f9c-48ca-4c3a-b6aa-fc4de63361e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:36.996071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230713-51ea-4949-9104-e6b887cc1929 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:37.062669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-48142f9c-48ca-4c3a-b6aa-fc4de63361e3 None None] MFA Rules not processed for user `b9c294dcd2b04859950da5c07f448640`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:37.065226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-48142f9c-48ca-4c3a-b6aa-fc4de63361e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:37.130632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:37.131549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:37.131888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:37.132223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] PATH_INFO: `/v3/projects/1c90fdf89f9249748dbc00fc63bbd775/users/ca10bb37957e43efb7cf40b14f374d18/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:37.134987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c90fdf89f9249748dbc00fc63bbd775, user_id=ca10bb37957e43efb7cf40b14f374d18, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:37.138392 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:37.161269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1020/2025] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:36 2022] PUT /identity/v3/projects/1c90fdf89f9249748dbc00fc63bbd775/users/ca10bb37957e43efb7cf40b14f374d18/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:37.171730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:37.177703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:37.187751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1006/2026] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:37.190628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1227bd-292c-4b5f-acb5-f491ef4e4923 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:37.191442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1227bd-292c-4b5f-acb5-f491ef4e4923 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:37.192233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1227bd-292c-4b5f-acb5-f491ef4e4923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:37.242086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4c1227bd-292c-4b5f-acb5-f491ef4e4923 None None] MFA Rules not processed for user `ca10bb37957e43efb7cf40b14f374d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:37.243243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4c1227bd-292c-4b5f-acb5-f491ef4e4923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:37.271282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:37.280625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794440-581d-4b38-a79d-6105c25778f7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:37.290033 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:37.290851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:37.291474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:37.291786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] PATH_INFO: `/v3/users/c0f1a7d559aa49d4a389ea819370a522` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:37.293314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f1a7d559aa49d4a389ea819370a522)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:37.295885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:37.381950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1007/2027] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:37.381950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1227bd-292c-4b5f-acb5-f491ef4e4923 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:37.381950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4c1227bd-292c-4b5f-acb5-f491ef4e4923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:37.390688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f1a7d559aa49d4a389ea819370a522'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:37.422012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f1a7d559aa49d4a389ea819370a522'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:37.435844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f1a7d559aa49d4a389ea819370a522'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:37.437362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f1a7d559aa49d4a389ea819370a522'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:37.438285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f1a7d559aa49d4a389ea819370a522'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:37.462482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1021/2028] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:37 2022] DELETE /identity/v3/users/c0f1a7d559aa49d4a389ea819370a522 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:37.464318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:37.467299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:37.502914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:37.507800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1227bd-292c-4b5f-acb5-f491ef4e4923 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:37.575567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489de272-f8a3-4e5a-8e2b-0fb81beddc64 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:37.582132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:37.583122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:37.583792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:37.584226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:37.587459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:37.590760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848a83d-3d98-4595-b8ab-c8fc0164f925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:37.591821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848a83d-3d98-4595-b8ab-c8fc0164f925 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:37.592423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848a83d-3d98-4595-b8ab-c8fc0164f925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:37.592799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848a83d-3d98-4595-b8ab-c8fc0164f925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:37.595868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d848a83d-3d98-4595-b8ab-c8fc0164f925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:37.683838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848a83d-3d98-4595-b8ab-c8fc0164f925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:37.685672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848a83d-3d98-4595-b8ab-c8fc0164f925 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:37.699376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1008/2029] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:37.701401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71b695-b861-4503-8e5c-f41c37ec962c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:37.701401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71b695-b861-4503-8e5c-f41c37ec962c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:37.701401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71b695-b861-4503-8e5c-f41c37ec962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:37.726313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2e71b695-b861-4503-8e5c-f41c37ec962c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:37.727370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:37.727613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2e71b695-b861-4503-8e5c-f41c37ec962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:37.731222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:37.759658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1022/2030] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:37.775913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:37.876192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1009/2031] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:37.892271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:37.898892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:38.073779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2726c-4b3c-4e82-8e7b-4c9217d68938 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:38.080727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21948f-1928-4852-b694-f8da273515b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:38.084905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21948f-1928-4852-b694-f8da273515b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:38.085327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21948f-1928-4852-b694-f8da273515b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:38.085702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21948f-1928-4852-b694-f8da273515b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:38.127894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21948f-1928-4852-b694-f8da273515b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:38.133074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21948f-1928-4852-b694-f8da273515b0 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:38.158921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1023/2032] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:38.862104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71b695-b861-4503-8e5c-f41c37ec962c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:38.886531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71b695-b861-4503-8e5c-f41c37ec962c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:38.895923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca10bb37957e43efb7cf40b14f374d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c90fdf89f9249748dbc00fc63bbd775', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:38.897563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:38.898319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:38.900545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:38.902519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:38.902519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:38.903825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:38.939220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1010/2033] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:38.940878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21948f-1928-4852-b694-f8da273515b0 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:38.957211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21948f-1928-4852-b694-f8da273515b0 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:38.962781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca10bb37957e43efb7cf40b14f374d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c90fdf89f9249748dbc00fc63bbd775', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:38.963557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:38.964094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:38.964502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:38.965301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:38.967403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:39.029285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1024/2034] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:38 2022] POST /identity/v3/projects => generated 352 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:39.034691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:39.061860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba7d4-9a59-483d-a581-7aac81cdbbbd tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:39.068031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:39.071401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:39.192534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca10bb37957e43efb7cf40b14f374d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c90fdf89f9249748dbc00fc63bbd775', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:39.193740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:39.194182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:39.194920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:39.195789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:39.196287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:39.198252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:39.213728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:39.216648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1011/2035] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:39.257822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5aa4d-4361-446a-9845-a57980fbd24a tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:39.264702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:39.265486 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:39.265884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:39.267137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] PATH_INFO: `/v3/projects/98088b8573d74fa4b3b84b5b18c61576` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:39.268781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98088b8573d74fa4b3b84b5b18c61576)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:39.271677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:39.300045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:39.311290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9ef62-8f08-4a2e-a52c-29f9f7584192 tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:39.320987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca10bb37957e43efb7cf40b14f374d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c90fdf89f9249748dbc00fc63bbd775', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:39.322060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:39.322796 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:39.323479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] PATH_INFO: `/v3/projects/82d509b80d354b2da017e3a5822d8e38` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:39.326156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82d509b80d354b2da017e3a5822d8e38)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:39.328870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:39.414540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98088b8573d74fa4b3b84b5b18c61576', 'request_id': 'req-29f831ee-568d-41c4-abd6-28e10f2ad5b3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.428876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98088b8573d74fa4b3b84b5b18c61576', 'request_id': 'req-29f831ee-568d-41c4-abd6-28e10f2ad5b3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.448378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98088b8573d74fa4b3b84b5b18c61576', 'request_id': 'req-29f831ee-568d-41c4-abd6-28e10f2ad5b3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.450702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d509b80d354b2da017e3a5822d8e38', 'request_id': 'req-e3db1699-4258-4308-b8fa-e502a6aaeacb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.463492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d509b80d354b2da017e3a5822d8e38', 'request_id': 'req-e3db1699-4258-4308-b8fa-e502a6aaeacb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.478977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d509b80d354b2da017e3a5822d8e38', 'request_id': 'req-e3db1699-4258-4308-b8fa-e502a6aaeacb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.488738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] The token cache is being invalidate because project 98088b8573d74fa4b3b84b5b18c61576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:39.489108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.490433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.501290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1025/2036] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:39 2022] DELETE /identity/v3/projects/98088b8573d74fa4b3b84b5b18c61576 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:39.501290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:39.503597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:39.503891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] The token cache is being invalidate because project 82d509b80d354b2da017e3a5822d8e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:39.504203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.504995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.516679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1012/2037] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:39 2022] DELETE /identity/v3/projects/82d509b80d354b2da017e3a5822d8e38 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:33:39.516679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:39.520350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:39.638430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:39.683115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f831ee-568d-41c4-abd6-28e10f2ad5b3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:39.703554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db1699-4258-4308-b8fa-e502a6aaeacb tempest-VolumeQuotaClassesTest-621640088 tempest-VolumeQuotaClassesTest-621640088-project-admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:39.715344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:39.716603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:39.717143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:39.718929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] PATH_INFO: `/v3/users/4348537c36ff475cafec11a657af7045` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:39.719803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4348537c36ff475cafec11a657af7045)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:39.723248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:39.797405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:39.798299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:39.798930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:39.799525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] PATH_INFO: `/v3/users/f9e3b3f85d1143589114912c96047dd0` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:39.801943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e3b3f85d1143589114912c96047dd0)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:39.804939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:39.841149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4348537c36ff475cafec11a657af7045'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.866447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4348537c36ff475cafec11a657af7045'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.867891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4348537c36ff475cafec11a657af7045'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.881285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:39.886205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4348537c36ff475cafec11a657af7045'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.920043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e3b3f85d1143589114912c96047dd0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.924979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4518a0c3-8556-4c95-8aa4-933db1c18396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4348537c36ff475cafec11a657af7045'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.957099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e3b3f85d1143589114912c96047dd0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.971232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1013/2038] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:39 2022] DELETE /identity/v3/users/4348537c36ff475cafec11a657af7045 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:39.985158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e3b3f85d1143589114912c96047dd0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.986107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e3b3f85d1143589114912c96047dd0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:39.987140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e3b3f85d1143589114912c96047dd0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:40.011089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1026/2039] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:39 2022] DELETE /identity/v3/users/f9e3b3f85d1143589114912c96047dd0 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:40.015868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bc18-3e4b-45da-b587-dd4f308e9367 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:40.016324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bc18-3e4b-45da-b587-dd4f308e9367 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:40.016757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bc18-3e4b-45da-b587-dd4f308e9367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:40.074526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8549bc18-3e4b-45da-b587-dd4f308e9367 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:40.084878 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8549bc18-3e4b-45da-b587-dd4f308e9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:40.140691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:40.143879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:40.301312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1014/2040] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:33:40.316952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bc18-3e4b-45da-b587-dd4f308e9367 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:40.321846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8549bc18-3e4b-45da-b587-dd4f308e9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:40.370408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382ef6-dac2-4b45-b96a-4adce927b6a9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:40.386083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:40.386717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:40.386999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:40.387280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] PATH_INFO: `/v3/users/20b63399749441b7bd0401ae2fc89f6d` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:40.391658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b63399749441b7bd0401ae2fc89f6d)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:40.394006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:40.489862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bc18-3e4b-45da-b587-dd4f308e9367 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:40.502521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7134bd7-8e8a-49dc-85d1-6c9ba6c346cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:40.503363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134bd7-8e8a-49dc-85d1-6c9ba6c346cd service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:40.503650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134bd7-8e8a-49dc-85d1-6c9ba6c346cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:40.504035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134bd7-8e8a-49dc-85d1-6c9ba6c346cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:40.540792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:40.547596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7134bd7-8e8a-49dc-85d1-6c9ba6c346cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:40.551346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7134bd7-8e8a-49dc-85d1-6c9ba6c346cd service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:40.579851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1015/2041] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:40.612560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b63399749441b7bd0401ae2fc89f6d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:40.642479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b63399749441b7bd0401ae2fc89f6d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:40.682844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b63399749441b7bd0401ae2fc89f6d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:40.683795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b63399749441b7bd0401ae2fc89f6d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:40.686004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b63399749441b7bd0401ae2fc89f6d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:40.755857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1027/2042] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:40 2022] DELETE /identity/v3/users/20b63399749441b7bd0401ae2fc89f6d => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:40.767596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360bb76-371f-42c2-b509-272b345ba73f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:40.768490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360bb76-371f-42c2-b509-272b345ba73f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:40.769237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360bb76-371f-42c2-b509-272b345ba73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:40.788799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:40.791889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:40.803536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d360bb76-371f-42c2-b509-272b345ba73f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:40.805888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d360bb76-371f-42c2-b509-272b345ba73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:40.894772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:40.933739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1016/2043] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:40.956322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360bb76-371f-42c2-b509-272b345ba73f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:40.958475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d360bb76-371f-42c2-b509-272b345ba73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:40.978041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd2c2-ebf1-4456-b1ba-035e30d4fcd5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:40.989092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:40.989401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:40.990261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:40.990820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] PATH_INFO: `/v3/projects/73542d7a66694441abf9f4f0cf04602c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:40.992516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73542d7a66694441abf9f4f0cf04602c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:40.994705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:41.120207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73542d7a66694441abf9f4f0cf04602c', 'request_id': 'req-bdc182ce-8f51-48c7-8cc8-fd873aa77043'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.126914 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360bb76-371f-42c2-b509-272b345ba73f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:41.138031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73542d7a66694441abf9f4f0cf04602c', 'request_id': 'req-bdc182ce-8f51-48c7-8cc8-fd873aa77043'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.153556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73542d7a66694441abf9f4f0cf04602c', 'request_id': 'req-bdc182ce-8f51-48c7-8cc8-fd873aa77043'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.186036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] The token cache is being invalidate because project 73542d7a66694441abf9f4f0cf04602c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:41.189333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.191453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bdc182ce-8f51-48c7-8cc8-fd873aa77043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.194380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1028/2044] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:40 2022] DELETE /identity/v3/projects/73542d7a66694441abf9f4f0cf04602c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:41.202829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d3c1-e64f-4f2f-9b06-8c998a4874b2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:41.203540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d3c1-e64f-4f2f-9b06-8c998a4874b2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:41.203974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d3c1-e64f-4f2f-9b06-8c998a4874b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:41.248765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ed21d3c1-e64f-4f2f-9b06-8c998a4874b2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:41.253949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ed21d3c1-e64f-4f2f-9b06-8c998a4874b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:41.318239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85324057-4b68-4637-bfeb-37402ef6298d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:41.319289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324057-4b68-4637-bfeb-37402ef6298d service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:41.319779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324057-4b68-4637-bfeb-37402ef6298d service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:41.320260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324057-4b68-4637-bfeb-37402ef6298d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:41.332251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-85324057-4b68-4637-bfeb-37402ef6298d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:41.479101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1029/2045] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:41.480609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d3c1-e64f-4f2f-9b06-8c998a4874b2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:41.502237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ed21d3c1-e64f-4f2f-9b06-8c998a4874b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:41.532029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85324057-4b68-4637-bfeb-37402ef6298d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:41.536151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85324057-4b68-4637-bfeb-37402ef6298d service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:41.551526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d3c1-e64f-4f2f-9b06-8c998a4874b2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:41.558545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:41.559789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:41.560497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:41.561263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] PATH_INFO: `/v3/projects/342a2195dde64a93ab897228efb36ee4` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:41.563668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] RBAC: Authorizing `identity:delete_project(project_id=342a2195dde64a93ab897228efb36ee4)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:41.570324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:41.581161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1017/2046] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:33:41.590065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfed1f-d1e2-4fc5-aa0f-aba0fad0ca0f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:41.590548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfed1f-d1e2-4fc5-aa0f-aba0fad0ca0f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:41.591027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfed1f-d1e2-4fc5-aa0f-aba0fad0ca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:41.653570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:41.700721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:41.703067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342a2195dde64a93ab897228efb36ee4', 'request_id': 'req-0c84fe58-70b2-420d-b656-8f4be7bbc35c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.719677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342a2195dde64a93ab897228efb36ee4', 'request_id': 'req-0c84fe58-70b2-420d-b656-8f4be7bbc35c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.724667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-efbfed1f-d1e2-4fc5-aa0f-aba0fad0ca0f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:41.734518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-efbfed1f-d1e2-4fc5-aa0f-aba0fad0ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:41.734936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342a2195dde64a93ab897228efb36ee4', 'request_id': 'req-0c84fe58-70b2-420d-b656-8f4be7bbc35c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.767335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] The token cache is being invalidate because project 342a2195dde64a93ab897228efb36ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:41.767472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.770706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c84fe58-70b2-420d-b656-8f4be7bbc35c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:41.784040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1030/2047] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:41 2022] DELETE /identity/v3/projects/342a2195dde64a93ab897228efb36ee4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:41.787147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a7bbd-4f1a-4408-b112-601d9d6a432d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:41.788967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a7bbd-4f1a-4408-b112-601d9d6a432d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:41.788967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a7bbd-4f1a-4408-b112-601d9d6a432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:41.844441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-434a7bbd-4f1a-4408-b112-601d9d6a432d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:41.847441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-434a7bbd-4f1a-4408-b112-601d9d6a432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:41.901221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1018/2048] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:41.910955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfed1f-d1e2-4fc5-aa0f-aba0fad0ca0f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:41.922797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfed1f-d1e2-4fc5-aa0f-aba0fad0ca0f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:41.929970 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:41.930718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:41.931145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:41.931519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:41.932583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:41.933043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:41.935857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:41.970054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1019/2049] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:41.978200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.007459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2705c0-9cde-4a8f-92d5-257d1256058c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.022149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f777-dd35-4b2b-93f8-edc013babc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.022898 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f777-dd35-4b2b-93f8-edc013babc94 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.023334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1031/2050] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:42.024755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f777-dd35-4b2b-93f8-edc013babc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.025080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f777-dd35-4b2b-93f8-edc013babc94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.025785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8f777-dd35-4b2b-93f8-edc013babc94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.029598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8f777-dd35-4b2b-93f8-edc013babc94 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.035972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b4dd-7386-42ad-8914-0336d2ce7df1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.037699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b4dd-7386-42ad-8914-0336d2ce7df1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.038067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b4dd-7386-42ad-8914-0336d2ce7df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.084560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b474b4dd-7386-42ad-8914-0336d2ce7df1 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:42.087692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b474b4dd-7386-42ad-8914-0336d2ce7df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:42.127865 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1020/2051] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:41 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:42.129581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f777-dd35-4b2b-93f8-edc013babc94 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.144335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1032/2052] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:42.146098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474b4dd-7386-42ad-8914-0336d2ce7df1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.179067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474b4dd-7386-42ad-8914-0336d2ce7df1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.263018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f777-dd35-4b2b-93f8-edc013babc94 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.273531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5933c-0070-40b2-a850-4536e5ff0126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.274181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5933c-0070-40b2-a850-4536e5ff0126 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.274466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5933c-0070-40b2-a850-4536e5ff0126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.277140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5933c-0070-40b2-a850-4536e5ff0126 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.278035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5933c-0070-40b2-a850-4536e5ff0126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.283886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5933c-0070-40b2-a850-4536e5ff0126 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.358810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1021/2053] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:42 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:42.364834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5933c-0070-40b2-a850-4536e5ff0126 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.368679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.371080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.371755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.372247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.376199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:42.376199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.384044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.397091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5933c-0070-40b2-a850-4536e5ff0126 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.410107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1033/2054] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:42.410107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.411810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc366c00-55e6-4fb6-8a95-5ecea5af31e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.412970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:42.413174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc366c00-55e6-4fb6-8a95-5ecea5af31e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.413174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc366c00-55e6-4fb6-8a95-5ecea5af31e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.413468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc366c00-55e6-4fb6-8a95-5ecea5af31e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.414217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc366c00-55e6-4fb6-8a95-5ecea5af31e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.416059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc366c00-55e6-4fb6-8a95-5ecea5af31e9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.440608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1022/2055] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:42.441860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc366c00-55e6-4fb6-8a95-5ecea5af31e9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.446226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588ad1e-9367-4dd2-9abe-b78da55c7b59 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.461974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc366c00-55e6-4fb6-8a95-5ecea5af31e9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.470477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.471534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.472376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.472729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] PATH_INFO: `/v3/projects/298ff6648f644087b944e9224dc888b7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.473453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acdba6-1f03-4a82-9732-c60a61a1ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.474038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298ff6648f644087b944e9224dc888b7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.474134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acdba6-1f03-4a82-9732-c60a61a1ee96 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.474355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acdba6-1f03-4a82-9732-c60a61a1ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.474652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acdba6-1f03-4a82-9732-c60a61a1ee96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.475332 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acdba6-1f03-4a82-9732-c60a61a1ee96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.476547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.477364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acdba6-1f03-4a82-9732-c60a61a1ee96 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.533834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1023/2056] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:42 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:42.533834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acdba6-1f03-4a82-9732-c60a61a1ee96 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.566857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298ff6648f644087b944e9224dc888b7', 'request_id': 'req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.581270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298ff6648f644087b944e9224dc888b7', 'request_id': 'req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.585186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:42.592219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298ff6648f644087b944e9224dc888b7', 'request_id': 'req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.603409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:42.618955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] The token cache is being invalidate because project 298ff6648f644087b944e9224dc888b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:42.619302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.620064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.622347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1034/2057] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:42 2022] DELETE /identity/v3/projects/298ff6648f644087b944e9224dc888b7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:42.623131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.624641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:42.678866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acdba6-1f03-4a82-9732-c60a61a1ee96 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.684501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.685152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.685532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.685909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.686720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.690802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.701281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1024/2058] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:42.702148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.703869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:42.719051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00f12-1cc4-4700-a904-15625660b698 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.724090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.724866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.725210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.725546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] PATH_INFO: `/v3/users/ca10bb37957e43efb7cf40b14f374d18` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.726803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca10bb37957e43efb7cf40b14f374d18)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.727006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e2a85-3f21-4fdd-a861-804b409cb4c5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.728865 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.732333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.732999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.733479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.733750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.734390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.736923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.764504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1035/2059] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:42 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:42.765452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.768014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:42.782278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d696-3b62-4dbf-8448-f25b13ef2926 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.790410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:42.791324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.791591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.791831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] PATH_INFO: `/v3/projects/ef385c20f8cc4ad6aa2406356d8e0939/users/1849456f299044169b9a78dfe22b5e7e/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.797761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca10bb37957e43efb7cf40b14f374d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.810522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca10bb37957e43efb7cf40b14f374d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.811882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca10bb37957e43efb7cf40b14f374d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.812506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef385c20f8cc4ad6aa2406356d8e0939, user_id=1849456f299044169b9a78dfe22b5e7e, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:42.812687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca10bb37957e43efb7cf40b14f374d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.815861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:42.823974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-85370823-1edb-4376-906a-ee5f6ef508bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca10bb37957e43efb7cf40b14f374d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:42.840444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1036/2060] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:42 2022] PUT /identity/v3/projects/ef385c20f8cc4ad6aa2406356d8e0939/users/1849456f299044169b9a78dfe22b5e7e/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:42.840444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.845114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:42.854717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1025/2061] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:42 2022] DELETE /identity/v3/users/ca10bb37957e43efb7cf40b14f374d18 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:42.856707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832580f1-af4d-4e29-b704-c8165d112c64 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.857069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832580f1-af4d-4e29-b704-c8165d112c64 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.858389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832580f1-af4d-4e29-b704-c8165d112c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.884185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-832580f1-af4d-4e29-b704-c8165d112c64 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:42.885568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-832580f1-af4d-4e29-b704-c8165d112c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:42.967288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52462140-9014-4c8e-82be-d854b2cfe1b2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:42.977725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1026/2062] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:42.980110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17351a50-c622-471b-9272-1e5f7533440e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:42.980705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17351a50-c622-471b-9272-1e5f7533440e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:42.981275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17351a50-c622-471b-9272-1e5f7533440e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:42.986653 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1027/2063] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:33:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:33:42.989289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17351a50-c622-471b-9272-1e5f7533440e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:42.992096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-17351a50-c622-471b-9272-1e5f7533440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.019284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17351a50-c622-471b-9272-1e5f7533440e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:43.028371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:43.029345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.029747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.030247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] PATH_INFO: `/v3/users/ca505faad29a4155a9c4f562b2b47dee` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.031683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca505faad29a4155a9c4f562b2b47dee)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:43.034494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:43.076175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:43.104493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca505faad29a4155a9c4f562b2b47dee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:43.104644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8a6c8-bfe4-4457-b705-c0630dda9d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:43.105278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8a6c8-bfe4-4457-b705-c0630dda9d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.105422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8a6c8-bfe4-4457-b705-c0630dda9d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.105873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8a6c8-bfe4-4457-b705-c0630dda9d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.106473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8a6c8-bfe4-4457-b705-c0630dda9d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:43.109469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8a6c8-bfe4-4457-b705-c0630dda9d8e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:43.112147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:43.119628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca505faad29a4155a9c4f562b2b47dee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:43.120652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca505faad29a4155a9c4f562b2b47dee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:43.121746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca505faad29a4155a9c4f562b2b47dee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:43.133721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1037/2064] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:43.135375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2c16-1abf-4477-9478-01e2fb25327d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.135497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2c16-1abf-4477-9478-01e2fb25327d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.135747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2c16-1abf-4477-9478-01e2fb25327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.136944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca505faad29a4155a9c4f562b2b47dee'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:43.162771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-619a2c16-1abf-4477-9478-01e2fb25327d None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:43.164653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-619a2c16-1abf-4477-9478-01e2fb25327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.184181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1028/2065] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:42 2022] DELETE /identity/v3/users/ca505faad29a4155a9c4f562b2b47dee => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:43.186206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:43.188756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.310399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1038/2066] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:43.313268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a2c16-1abf-4477-9478-01e2fb25327d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:43.316065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-619a2c16-1abf-4477-9478-01e2fb25327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.318975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d035d05-6ea8-4df0-bbf8-81d3ae358996 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:43.323329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf0cf4-4b78-4464-ad14-aa771b58f5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:43.323990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf0cf4-4b78-4464-ad14-aa771b58f5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.324272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf0cf4-4b78-4464-ad14-aa771b58f5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.324715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf0cf4-4b78-4464-ad14-aa771b58f5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.327011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4ddf0cf4-4b78-4464-ad14-aa771b58f5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.347719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a2c16-1abf-4477-9478-01e2fb25327d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:43.464480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf0cf4-4b78-4464-ad14-aa771b58f5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:43.464480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf0cf4-4b78-4464-ad14-aa771b58f5f0 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:43.485851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1029/2067] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:43.487667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1268-77bc-40f9-858f-83bec403a49e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.487858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1268-77bc-40f9-858f-83bec403a49e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.488129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1268-77bc-40f9-858f-83bec403a49e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.490760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1030/2068] 10.222.0.55 () {54 vars in 961 bytes} [Tue Sep 13 12:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:33:43.497904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961103-bfa5-44ba-976b-36d38407cbb4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.498422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961103-bfa5-44ba-976b-36d38407cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.498422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961103-bfa5-44ba-976b-36d38407cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.506367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c644-f03b-4819-a08e-f8f43e0fe8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:43.508587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c644-f03b-4819-a08e-f8f43e0fe8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.509102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c644-f03b-4819-a08e-f8f43e0fe8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.509682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c644-f03b-4819-a08e-f8f43e0fe8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.511342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c644-f03b-4819-a08e-f8f43e0fe8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:43.512898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c644-f03b-4819-a08e-f8f43e0fe8b8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:43.526867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-25961103-bfa5-44ba-976b-36d38407cbb4 None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:43.528264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-25961103-bfa5-44ba-976b-36d38407cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.532111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1039/2069] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:43.542125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c644-f03b-4819-a08e-f8f43e0fe8b8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:43.559128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c644-f03b-4819-a08e-f8f43e0fe8b8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:43.585657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c84506-e286-4a10-8b90-d4edb9d92c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:43.588089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84506-e286-4a10-8b90-d4edb9d92c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.589051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84506-e286-4a10-8b90-d4edb9d92c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.589773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84506-e286-4a10-8b90-d4edb9d92c9d admin admin] PATH_INFO: `/v3/projects/8a693ab56ef4401f8bf7dae678eeb6f3/users/151a9b6135264c0fa0f272a9115bf9c9/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.621573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c84506-e286-4a10-8b90-d4edb9d92c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a693ab56ef4401f8bf7dae678eeb6f3, user_id=151a9b6135264c0fa0f272a9115bf9c9, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:43.633830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:43.636800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c84506-e286-4a10-8b90-d4edb9d92c9d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:43.680546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1031/2070] 10.222.0.55 () {58 vars in 1058 bytes} [Tue Sep 13 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:43.680788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1040/2071] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:43 2022] PUT /identity/v3/projects/8a693ab56ef4401f8bf7dae678eeb6f3/users/151a9b6135264c0fa0f272a9115bf9c9/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:43.690762 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979e6fb-da23-4807-9c01-a730916fd6ba None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.691041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979e6fb-da23-4807-9c01-a730916fd6ba None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.691393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979e6fb-da23-4807-9c01-a730916fd6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.704450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c84506-e286-4a10-8b90-d4edb9d92c9d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:43.737214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e979e6fb-da23-4807-9c01-a730916fd6ba None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:43.739484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e979e6fb-da23-4807-9c01-a730916fd6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.866169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c84506-e286-4a10-8b90-d4edb9d92c9d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:43.869971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1032/2072] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:43.870979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979e6fb-da23-4807-9c01-a730916fd6ba None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:43.876825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:43.877993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.878418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e979e6fb-da23-4807-9c01-a730916fd6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.878608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.879069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.888557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:43.897822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:43.900310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:43.906535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979e6fb-da23-4807-9c01-a730916fd6ba None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:43.917701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:43.919618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:43.920829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:43.921287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] PATH_INFO: `/v3/projects/1c90fdf89f9249748dbc00fc63bbd775` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:43.922965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c90fdf89f9249748dbc00fc63bbd775)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:43.926789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:43.937732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1041/2073] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:33:43.939200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:43.943737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:43.971707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f789d-ce9d-412e-b400-d5c1f55beeda service placement] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:43.998810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c90fdf89f9249748dbc00fc63bbd775', 'request_id': 'req-5d68698e-2272-4fec-8d1c-7ee7882edd9a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.009079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c90fdf89f9249748dbc00fc63bbd775', 'request_id': 'req-5d68698e-2272-4fec-8d1c-7ee7882edd9a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.023589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c90fdf89f9249748dbc00fc63bbd775', 'request_id': 'req-5d68698e-2272-4fec-8d1c-7ee7882edd9a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.047149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] The token cache is being invalidate because project 1c90fdf89f9249748dbc00fc63bbd775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:44.047522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.048295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.053854 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1033/2074] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:43 2022] DELETE /identity/v3/projects/1c90fdf89f9249748dbc00fc63bbd775 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:44.062436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:44.066396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.106248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:44.107148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.107666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.107952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] PATH_INFO: `/v3/projects/409fba5f7d3140fea63b7d03a2884540` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.109753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=409fba5f7d3140fea63b7d03a2884540)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:44.113768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:44.209394 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409fba5f7d3140fea63b7d03a2884540', 'request_id': 'req-90225836-a7c9-4042-b4b9-1520e8884f57'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.229196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409fba5f7d3140fea63b7d03a2884540', 'request_id': 'req-90225836-a7c9-4042-b4b9-1520e8884f57'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.229774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68698e-2272-4fec-8d1c-7ee7882edd9a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:44.246980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409fba5f7d3140fea63b7d03a2884540', 'request_id': 'req-90225836-a7c9-4042-b4b9-1520e8884f57'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.274337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] The token cache is being invalidate because project 409fba5f7d3140fea63b7d03a2884540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:44.275722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.276965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-90225836-a7c9-4042-b4b9-1520e8884f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.279743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:44.281190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1042/2075] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:43 2022] DELETE /identity/v3/projects/409fba5f7d3140fea63b7d03a2884540 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:44.283964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91008-486d-4e92-9e58-041f66508bec None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.290845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91008-486d-4e92-9e58-041f66508bec None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.291575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91008-486d-4e92-9e58-041f66508bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.326251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34be5-48d1-4cf3-bb8f-87bbc64590e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:44.328782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34be5-48d1-4cf3-bb8f-87bbc64590e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.329834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34be5-48d1-4cf3-bb8f-87bbc64590e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.330192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34be5-48d1-4cf3-bb8f-87bbc64590e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.335407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-53d34be5-48d1-4cf3-bb8f-87bbc64590e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.335627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b1d91008-486d-4e92-9e58-041f66508bec None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:44.341134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b1d91008-486d-4e92-9e58-041f66508bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.438649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1043/2076] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:44.438649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49bc2-3352-4732-af53-ea22236ff359 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.438649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49bc2-3352-4732-af53-ea22236ff359 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.438649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49bc2-3352-4732-af53-ea22236ff359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.470669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-20c49bc2-3352-4732-af53-ea22236ff359 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:44.472127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-20c49bc2-3352-4732-af53-ea22236ff359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.486313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1044/2077] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:44.487230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c49bc2-3352-4732-af53-ea22236ff359 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:44.489155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-20c49bc2-3352-4732-af53-ea22236ff359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.511320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34be5-48d1-4cf3-bb8f-87bbc64590e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:44.513391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34be5-48d1-4cf3-bb8f-87bbc64590e5 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:44.514539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c49bc2-3352-4732-af53-ea22236ff359 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:44.523067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:44.523960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.524237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.524553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] PATH_INFO: `/v3/users/b9c294dcd2b04859950da5c07f448640` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.525822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c294dcd2b04859950da5c07f448640)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:44.527079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1034/2078] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:44.528061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:44.529149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c8889-0d80-4149-96e1-d2e59c87f5c0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.529467 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c8889-0d80-4149-96e1-d2e59c87f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.529840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c8889-0d80-4149-96e1-d2e59c87f5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.552756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-179c8889-0d80-4149-96e1-d2e59c87f5c0 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:44.553771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:44.554413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-179c8889-0d80-4149-96e1-d2e59c87f5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.569051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1035/2079] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:44.569051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed69ad-5182-4e56-81ef-91d9ac5252cb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.569051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed69ad-5182-4e56-81ef-91d9ac5252cb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.569051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed69ad-5182-4e56-81ef-91d9ac5252cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.593512 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c4ed69ad-5182-4e56-81ef-91d9ac5252cb None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:44.594798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c4ed69ad-5182-4e56-81ef-91d9ac5252cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.606388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1036/2080] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:44.607265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed69ad-5182-4e56-81ef-91d9ac5252cb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:44.614622 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c294dcd2b04859950da5c07f448640'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.622561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed69ad-5182-4e56-81ef-91d9ac5252cb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:44.629229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:44.630501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.630590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.630925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.631917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:44.632437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:44.634766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:44.640774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c294dcd2b04859950da5c07f448640'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.655599 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1037/2081] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:44.656449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:44.670674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565ff0a-101c-46f5-9186-db8dcae9fc71 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:44.680747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:44.681510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c294dcd2b04859950da5c07f448640'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.682405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.682719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.682986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.683390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c294dcd2b04859950da5c07f448640'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.684895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7c82903a-634d-4619-9f1e-20d9b702d27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c294dcd2b04859950da5c07f448640'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:44.687960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:33:44.688709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:44.691721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:44.726471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1038/2082] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:33:44.726471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:44.729146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.741131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1045/2083] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:33:44 2022] DELETE /identity/v3/users/b9c294dcd2b04859950da5c07f448640 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:44.743220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28b77-6bdb-4949-a114-30a33b147d6b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.743753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28b77-6bdb-4949-a114-30a33b147d6b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.744175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28b77-6bdb-4949-a114-30a33b147d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.760124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51ff77-24fe-4a41-91f7-1f8c89da48d3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:44.797283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e0d28b77-6bdb-4949-a114-30a33b147d6b None None] MFA Rules not processed for user `1849456f299044169b9a78dfe22b5e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:44.800169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e0d28b77-6bdb-4949-a114-30a33b147d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.861331 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:44.862224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.862513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.862788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:44.863513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:44.866669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:44.903649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1039/2084] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:44 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:44.908701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:44.911813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:44.961619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:44.966461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1046/2085] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:44.966461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55322d6-2019-4a18-b028-d7fc14cb4e30 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:44.966461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55322d6-2019-4a18-b028-d7fc14cb4e30 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:44.966461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55322d6-2019-4a18-b028-d7fc14cb4e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.004522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a55322d6-2019-4a18-b028-d7fc14cb4e30 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:45.006173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a55322d6-2019-4a18-b028-d7fc14cb4e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:45.018867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafdd36-5252-4c58-9f1c-ea08f0a4252a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.023070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1047/2086] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:45.023874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55322d6-2019-4a18-b028-d7fc14cb4e30 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.026186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.026563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.027005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.027378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.028127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.031337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.035456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55322d6-2019-4a18-b028-d7fc14cb4e30 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.041385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.042165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.042582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.043101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.043893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.045911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.068986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1040/2087] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:44 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:45.070504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.072897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:45.079620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1048/2088] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:45 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:45.079620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.082235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:45.188354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9a90-b843-4eaa-bc75-027bb41e9744 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.206057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:45.207988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cc5c4-fe79-4d8a-969c-dfa07226e0af admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.218713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55353d-cebc-4656-9ae2-a4b91035ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.219968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55353d-cebc-4656-9ae2-a4b91035ead0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.220737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55353d-cebc-4656-9ae2-a4b91035ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.221286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55353d-cebc-4656-9ae2-a4b91035ead0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.222550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55353d-cebc-4656-9ae2-a4b91035ead0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.227346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55353d-cebc-4656-9ae2-a4b91035ead0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.294487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1041/2089] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:45 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:45.296936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55353d-cebc-4656-9ae2-a4b91035ead0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.306374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dc0df-0d0e-48c4-8e76-928c52f567ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.307015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dc0df-0d0e-48c4-8e76-928c52f567ba service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.307325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dc0df-0d0e-48c4-8e76-928c52f567ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.307595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dc0df-0d0e-48c4-8e76-928c52f567ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.321854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dc0df-0d0e-48c4-8e76-928c52f567ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.323248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dc0df-0d0e-48c4-8e76-928c52f567ba service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.335251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1049/2090] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:45.335662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dc0df-0d0e-48c4-8e76-928c52f567ba service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.351013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dc0df-0d0e-48c4-8e76-928c52f567ba service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.412712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55353d-cebc-4656-9ae2-a4b91035ead0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.417920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca603-4cb5-4f33-bd96-c58cb4df588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.419001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca603-4cb5-4f33-bd96-c58cb4df588a admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.419001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca603-4cb5-4f33-bd96-c58cb4df588a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.419205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca603-4cb5-4f33-bd96-c58cb4df588a admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.419755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eca603-4cb5-4f33-bd96-c58cb4df588a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.421804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eca603-4cb5-4f33-bd96-c58cb4df588a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.453608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1042/2091] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:45 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:45.453608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca603-4cb5-4f33-bd96-c58cb4df588a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.458819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941e561-8ab2-43d7-91ff-9e4bfe4ddac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.459806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941e561-8ab2-43d7-91ff-9e4bfe4ddac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.460231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941e561-8ab2-43d7-91ff-9e4bfe4ddac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.460602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941e561-8ab2-43d7-91ff-9e4bfe4ddac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.461367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941e561-8ab2-43d7-91ff-9e4bfe4ddac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.463114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941e561-8ab2-43d7-91ff-9e4bfe4ddac7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.464753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca603-4cb5-4f33-bd96-c58cb4df588a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.473074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ad1c-1f0d-48c4-b1cc-cf66bce261a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.474440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ad1c-1f0d-48c4-b1cc-cf66bce261a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.474944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ad1c-1f0d-48c4-b1cc-cf66bce261a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.475369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ad1c-1f0d-48c4-b1cc-cf66bce261a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.475708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1050/2092] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:45.476671 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ad1c-1f0d-48c4-b1cc-cf66bce261a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.479878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941e561-8ab2-43d7-91ff-9e4bfe4ddac7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.480765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ad1c-1f0d-48c4-b1cc-cf66bce261a4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.491269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941e561-8ab2-43d7-91ff-9e4bfe4ddac7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.499655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eb00f-1850-4297-b054-0402ec25dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.500573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb00f-1850-4297-b054-0402ec25dd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.500915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb00f-1850-4297-b054-0402ec25dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.501854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb00f-1850-4297-b054-0402ec25dd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.502264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465eb00f-1850-4297-b054-0402ec25dd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.504256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465eb00f-1850-4297-b054-0402ec25dd52 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.511959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1043/2093] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:45 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:45.513342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ad1c-1f0d-48c4-b1cc-cf66bce261a4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.523797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1051/2094] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:45.524992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eb00f-1850-4297-b054-0402ec25dd52 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.528481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ad1c-1f0d-48c4-b1cc-cf66bce261a4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.534810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9875b80-2b49-4a3b-8408-c6a4d3e49ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.535455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875b80-2b49-4a3b-8408-c6a4d3e49ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.535896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875b80-2b49-4a3b-8408-c6a4d3e49ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.536196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875b80-2b49-4a3b-8408-c6a4d3e49ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.537052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9875b80-2b49-4a3b-8408-c6a4d3e49ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.537382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eb00f-1850-4297-b054-0402ec25dd52 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.539010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9875b80-2b49-4a3b-8408-c6a4d3e49ba7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.542551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:45.543584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fcd39-ae00-4794-a1d5-5132d4658da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.544244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fcd39-ae00-4794-a1d5-5132d4658da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.544646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fcd39-ae00-4794-a1d5-5132d4658da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.545100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fcd39-ae00-4794-a1d5-5132d4658da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.545801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fcd39-ae00-4794-a1d5-5132d4658da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.548002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fcd39-ae00-4794-a1d5-5132d4658da9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.563793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1044/2095] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:45.565669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9875b80-2b49-4a3b-8408-c6a4d3e49ba7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.568884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1052/2096] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:45.569944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fcd39-ae00-4794-a1d5-5132d4658da9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.590475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fcd39-ae00-4794-a1d5-5132d4658da9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.598860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28ca8-b5ad-40d8-b481-0127abccfba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.600498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28ca8-b5ad-40d8-b481-0127abccfba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.601018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28ca8-b5ad-40d8-b481-0127abccfba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.601571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28ca8-b5ad-40d8-b481-0127abccfba1 admin admin] PATH_INFO: `/v3/projects/62b13090709c4dfa9237cb5aee55c36b/users/1828276ad66d4c9390dfa36bb4aa0bbc/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.607880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9875b80-2b49-4a3b-8408-c6a4d3e49ba7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.624280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a28ca8-b5ad-40d8-b481-0127abccfba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b13090709c4dfa9237cb5aee55c36b, user_id=1828276ad66d4c9390dfa36bb4aa0bbc, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.624572 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16245242-32c0-481f-9879-02135fa55676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.625043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16245242-32c0-481f-9879-02135fa55676 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.625323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16245242-32c0-481f-9879-02135fa55676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.625595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16245242-32c0-481f-9879-02135fa55676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.626446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16245242-32c0-481f-9879-02135fa55676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.628404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16245242-32c0-481f-9879-02135fa55676 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.631024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a28ca8-b5ad-40d8-b481-0127abccfba1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.647935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1045/2097] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:45.651249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16245242-32c0-481f-9879-02135fa55676 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.659691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1053/2098] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:45 2022] PUT /identity/v3/projects/62b13090709c4dfa9237cb5aee55c36b/users/1828276ad66d4c9390dfa36bb4aa0bbc/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:45.661001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28ca8-b5ad-40d8-b481-0127abccfba1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.671159 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16245242-32c0-481f-9879-02135fa55676 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.770448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28ca8-b5ad-40d8-b481-0127abccfba1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.782879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0fcae-f118-48d6-b445-a1369ff73480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.783570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0fcae-f118-48d6-b445-a1369ff73480 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.784053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0fcae-f118-48d6-b445-a1369ff73480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.784319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0fcae-f118-48d6-b445-a1369ff73480 admin admin] PATH_INFO: `/v3/projects/f8c875572a4a41fe8829be52fb8aedb1/users/686c11bf06de4a0480b637d70ddc0ec2/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.807801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:45.811991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0fcae-f118-48d6-b445-a1369ff73480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c875572a4a41fe8829be52fb8aedb1, user_id=686c11bf06de4a0480b637d70ddc0ec2, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.816362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0fcae-f118-48d6-b445-a1369ff73480 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.825975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:45.826983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:45.827325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:45.827598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] PATH_INFO: `/v3/projects/ec0a8582517e4234be416fbb120c29c2/users/6be308610d1f4750a9764abe8f2b0f27/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:45.842452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1054/2099] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:45 2022] PUT /identity/v3/projects/f8c875572a4a41fe8829be52fb8aedb1/users/686c11bf06de4a0480b637d70ddc0ec2/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:45.843471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0fcae-f118-48d6-b445-a1369ff73480 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.875749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0a8582517e4234be416fbb120c29c2, user_id=6be308610d1f4750a9764abe8f2b0f27, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:45.882998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:45.925804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1046/2100] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:45 2022] PUT /identity/v3/projects/ec0a8582517e4234be416fbb120c29c2/users/6be308610d1f4750a9764abe8f2b0f27/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:45.926165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0fcae-f118-48d6-b445-a1369ff73480 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:45.931155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:45.942949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:46.038389 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48055a7f-0bd3-423b-8e2f-ba19d40f2a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:46.041359 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055a7f-0bd3-423b-8e2f-ba19d40f2a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:46.042003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055a7f-0bd3-423b-8e2f-ba19d40f2a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:46.042624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055a7f-0bd3-423b-8e2f-ba19d40f2a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:46.044066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055a7f-0bd3-423b-8e2f-ba19d40f2a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:46.048028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055a7f-0bd3-423b-8e2f-ba19d40f2a58 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:46.071391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1055/2101] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:46.074705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d2c2a-d9c1-497e-af69-332d0d553fce None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:46.075328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d2c2a-d9c1-497e-af69-332d0d553fce None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:46.075920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d2c2a-d9c1-497e-af69-332d0d553fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:46.085389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3abc0-dbcf-482d-8217-7e5cc1efee29 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:46.092137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:46.092903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:46.093193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:46.093479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] PATH_INFO: `/v3/projects/e930ab73023542c7bceff694b13a5896` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:46.096583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e930ab73023542c7bceff694b13a5896)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:46.101645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:46.114225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-056d2c2a-d9c1-497e-af69-332d0d553fce None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:46.116834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-056d2c2a-d9c1-497e-af69-332d0d553fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:46.132718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1056/2102] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:46.135652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94da196-8f6a-41b2-81a3-4155e9f83012 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:46.136510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94da196-8f6a-41b2-81a3-4155e9f83012 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:46.137276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94da196-8f6a-41b2-81a3-4155e9f83012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:46.193149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e930ab73023542c7bceff694b13a5896', 'request_id': 'req-9c112f25-e242-431b-9c5d-c8301b65cf53'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:46.202302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e930ab73023542c7bceff694b13a5896', 'request_id': 'req-9c112f25-e242-431b-9c5d-c8301b65cf53'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:46.208519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b94da196-8f6a-41b2-81a3-4155e9f83012 None None] MFA Rules not processed for user `6be308610d1f4750a9764abe8f2b0f27`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:46.214710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b94da196-8f6a-41b2-81a3-4155e9f83012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:46.218532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e930ab73023542c7bceff694b13a5896', 'request_id': 'req-9c112f25-e242-431b-9c5d-c8301b65cf53'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:46.247085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:46.254660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] The token cache is being invalidate because project e930ab73023542c7bceff694b13a5896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:33:46.255310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:46.256361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:33:46.268799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1047/2103] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:33:45 2022] DELETE /identity/v3/projects/e930ab73023542c7bceff694b13a5896 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:46.281374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:46.299821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:46.366977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1057/2104] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:46.368308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94da196-8f6a-41b2-81a3-4155e9f83012 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:46.374024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b94da196-8f6a-41b2-81a3-4155e9f83012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:46.415015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:46.455493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112f25-e242-431b-9c5d-c8301b65cf53 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:46.479249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:46.479977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:46.480274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:46.480597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] PATH_INFO: `/v3/projects/62b13090709c4dfa9237cb5aee55c36b/users/1828276ad66d4c9390dfa36bb4aa0bbc/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:46.492295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b13090709c4dfa9237cb5aee55c36b, user_id=1828276ad66d4c9390dfa36bb4aa0bbc, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:46.495122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:46.522111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1048/2105] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:46 2022] PUT /identity/v3/projects/62b13090709c4dfa9237cb5aee55c36b/users/1828276ad66d4c9390dfa36bb4aa0bbc/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:46.523232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:46.525279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:46.542088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94da196-8f6a-41b2-81a3-4155e9f83012 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:46.619540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f377fc6-0faf-4d1f-a25d-b045778e812f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:46.624206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cba1d8-b8d1-430e-af30-d46712f5044e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7ccabe29f4464bafbdd7b5aab7d775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:46.625219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cba1d8-b8d1-430e-af30-d46712f5044e service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:46.625627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cba1d8-b8d1-430e-af30-d46712f5044e service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:46.625900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cba1d8-b8d1-430e-af30-d46712f5044e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:46.663693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8952e-f656-477c-866d-54f3032b645b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:46.664360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8952e-f656-477c-866d-54f3032b645b service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:46.664660 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8952e-f656-477c-866d-54f3032b645b service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:46.664931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8952e-f656-477c-866d-54f3032b645b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:46.671430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d3e8952e-f656-477c-866d-54f3032b645b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:46.719454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cba1d8-b8d1-430e-af30-d46712f5044e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:46.721900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cba1d8-b8d1-430e-af30-d46712f5044e service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:46.740432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1049/2106] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:46.809999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8952e-f656-477c-866d-54f3032b645b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:46.811588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8952e-f656-477c-866d-54f3032b645b service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:46.823783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1058/2107] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:47.967690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2362-bac8-4239-a719-42ec5d168f37 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:47.968193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2362-bac8-4239-a719-42ec5d168f37 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:47.968295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2362-bac8-4239-a719-42ec5d168f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:48.011679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c7ea2362-bac8-4239-a719-42ec5d168f37 None None] MFA Rules not processed for user `1828276ad66d4c9390dfa36bb4aa0bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:48.013578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c7ea2362-bac8-4239-a719-42ec5d168f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:48.079089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:48.144445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1050/2108] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:48.168254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be255f-1f8f-44f0-856c-916e623bbbe0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:48.168992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be255f-1f8f-44f0-856c-916e623bbbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:48.170011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be255f-1f8f-44f0-856c-916e623bbbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:48.196008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-71be255f-1f8f-44f0-856c-916e623bbbe0 None None] MFA Rules not processed for user `1849456f299044169b9a78dfe22b5e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:48.201083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-71be255f-1f8f-44f0-856c-916e623bbbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:48.306235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1059/2109] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:48.314275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2362-bac8-4239-a719-42ec5d168f37 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:48.316063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c7ea2362-bac8-4239-a719-42ec5d168f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:48.423819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2362-bac8-4239-a719-42ec5d168f37 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:48.431245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:48.433348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:48.434111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:48.434562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:48.437853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:48.470700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:48.474055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:48.493663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1051/2110] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:33:53.643124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125e55-b9eb-4a5c-b921-2aa64062d48f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:53.643827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125e55-b9eb-4a5c-b921-2aa64062d48f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:53.643827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125e55-b9eb-4a5c-b921-2aa64062d48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:53.741448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-74125e55-b9eb-4a5c-b921-2aa64062d48f None None] MFA Rules not processed for user `151a9b6135264c0fa0f272a9115bf9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:53.743261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-74125e55-b9eb-4a5c-b921-2aa64062d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:53.768858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:53.858996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1060/2111] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:53.864243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:53.866568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:53.888652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ee4c2-8f23-4756-a1a7-4cde35e71d86 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:53.901296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86851-50e5-49a7-b9b8-a77108b9662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:53.901935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86851-50e5-49a7-b9b8-a77108b9662e admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:53.902208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86851-50e5-49a7-b9b8-a77108b9662e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:53.903859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86851-50e5-49a7-b9b8-a77108b9662e admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:53.904570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e86851-50e5-49a7-b9b8-a77108b9662e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:53.907867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e86851-50e5-49a7-b9b8-a77108b9662e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:53.947707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1052/2112] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:33:53 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:53.952445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125e55-b9eb-4a5c-b921-2aa64062d48f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:53.989857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125e55-b9eb-4a5c-b921-2aa64062d48f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:54.115802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181b39-ac3f-4429-8d97-090ed3d063e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:54.116571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181b39-ac3f-4429-8d97-090ed3d063e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:54.116846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181b39-ac3f-4429-8d97-090ed3d063e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:54.117117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181b39-ac3f-4429-8d97-090ed3d063e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:54.117760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31181b39-ac3f-4429-8d97-090ed3d063e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:54.119791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31181b39-ac3f-4429-8d97-090ed3d063e9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:54.161263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1061/2113] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:33:53 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:33:54.162546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86851-50e5-49a7-b9b8-a77108b9662e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:54.196475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86851-50e5-49a7-b9b8-a77108b9662e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:54.234010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ee424-3a6e-4269-bf2d-ed460bfbed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:54.234656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee424-3a6e-4269-bf2d-ed460bfbed47 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:54.234943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee424-3a6e-4269-bf2d-ed460bfbed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:54.235261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee424-3a6e-4269-bf2d-ed460bfbed47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:54.236075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ee424-3a6e-4269-bf2d-ed460bfbed47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:54.237872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ee424-3a6e-4269-bf2d-ed460bfbed47 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:54.251341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1053/2114] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:54.256058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181b39-ac3f-4429-8d97-090ed3d063e9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:54.275152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181b39-ac3f-4429-8d97-090ed3d063e9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:54.285849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1388a-7659-4a80-831f-0b993002434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:54.286552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1388a-7659-4a80-831f-0b993002434f admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:54.286828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1388a-7659-4a80-831f-0b993002434f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:54.287103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1388a-7659-4a80-831f-0b993002434f admin admin] PATH_INFO: `/v3/projects/a544f7fd638a4661b5804f19ee282d5b/users/060c005229fb427f8b10b985c91a7e7a/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:54.328235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1388a-7659-4a80-831f-0b993002434f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a544f7fd638a4661b5804f19ee282d5b, user_id=060c005229fb427f8b10b985c91a7e7a, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:54.332319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1388a-7659-4a80-831f-0b993002434f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:54.368354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1062/2115] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:54 2022] PUT /identity/v3/projects/a544f7fd638a4661b5804f19ee282d5b/users/060c005229fb427f8b10b985c91a7e7a/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:54.372592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ee424-3a6e-4269-bf2d-ed460bfbed47 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:54.387140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ee424-3a6e-4269-bf2d-ed460bfbed47 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:54.525876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8142-ef67-40d5-aa42-f626f598714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:54.526645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8142-ef67-40d5-aa42-f626f598714e admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:54.526935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8142-ef67-40d5-aa42-f626f598714e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:54.527211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8142-ef67-40d5-aa42-f626f598714e admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:54.527928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b8142-ef67-40d5-aa42-f626f598714e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:54.529705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b8142-ef67-40d5-aa42-f626f598714e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:54.548907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1054/2116] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:33:54.554730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1388a-7659-4a80-831f-0b993002434f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:54.585418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1388a-7659-4a80-831f-0b993002434f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:54.603385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:54.605835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:54.606262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:54.607786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] PATH_INFO: `/v3/projects/a544f7fd638a4661b5804f19ee282d5b/users/060c005229fb427f8b10b985c91a7e7a/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:54.610619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a544f7fd638a4661b5804f19ee282d5b, user_id=060c005229fb427f8b10b985c91a7e7a, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:54.619507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:54.656768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1063/2117] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:33:54 2022] PUT /identity/v3/projects/a544f7fd638a4661b5804f19ee282d5b/users/060c005229fb427f8b10b985c91a7e7a/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:33:57.389988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931a8c9-061d-4371-b8f4-591ccc78944b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:57.389988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931a8c9-061d-4371-b8f4-591ccc78944b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:57.389988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931a8c9-061d-4371-b8f4-591ccc78944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:57.460474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a931a8c9-061d-4371-b8f4-591ccc78944b None None] MFA Rules not processed for user `686c11bf06de4a0480b637d70ddc0ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:33:57.462002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a931a8c9-061d-4371-b8f4-591ccc78944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:57.478496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:57.636621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1055/2118] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:33:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:33:57.651119 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:33:57.654209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:33:57.830692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:33:57.838808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746cb6-278e-4ba3-8b81-d528d502829c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:33:57.859676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf1e9a-f98c-425d-8f06-697cc7f9d637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:33:57.864976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf1e9a-f98c-425d-8f06-697cc7f9d637 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:33:57.865414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf1e9a-f98c-425d-8f06-697cc7f9d637 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:33:57.865722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf1e9a-f98c-425d-8f06-697cc7f9d637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:33:57.884818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf1e9a-f98c-425d-8f06-697cc7f9d637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:33:57.887336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf1e9a-f98c-425d-8f06-697cc7f9d637 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:33:57.900767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1064/2119] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:33:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:01.482592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915b59-78b4-40ae-80fe-c03dd6a22ce2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:01.483641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915b59-78b4-40ae-80fe-c03dd6a22ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:01.483929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915b59-78b4-40ae-80fe-c03dd6a22ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:01.542779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a2915b59-78b4-40ae-80fe-c03dd6a22ce2 None None] MFA Rules not processed for user `686c11bf06de4a0480b637d70ddc0ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:01.547942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a2915b59-78b4-40ae-80fe-c03dd6a22ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:01.564156 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1056/2120] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:04.357641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204e96-b409-4236-95ff-1a3a8b85af04 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:04.358748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204e96-b409-4236-95ff-1a3a8b85af04 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:04.359280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204e96-b409-4236-95ff-1a3a8b85af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:04.406430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-25204e96-b409-4236-95ff-1a3a8b85af04 None None] MFA Rules not processed for user `060c005229fb427f8b10b985c91a7e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:04.408048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-25204e96-b409-4236-95ff-1a3a8b85af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:04.499368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1065/2121] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:04.515613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2915b59-78b4-40ae-80fe-c03dd6a22ce2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:04.604011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2915b59-78b4-40ae-80fe-c03dd6a22ce2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:04.608687 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884c630-41f8-427b-809a-62e47b90d61b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7ccabe29f4464bafbdd7b5aab7d775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:04.609453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884c630-41f8-427b-809a-62e47b90d61b service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:04.609746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884c630-41f8-427b-809a-62e47b90d61b service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:04.609991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884c630-41f8-427b-809a-62e47b90d61b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:04.713766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884c630-41f8-427b-809a-62e47b90d61b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:04.725317 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884c630-41f8-427b-809a-62e47b90d61b service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:04.737695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1057/2122] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:04.994219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204e96-b409-4236-95ff-1a3a8b85af04 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:04.998185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-25204e96-b409-4236-95ff-1a3a8b85af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:05.107066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517387-2870-4829-a0c3-9ff6e8ce9c61 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:05.107363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517387-2870-4829-a0c3-9ff6e8ce9c61 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:05.107711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517387-2870-4829-a0c3-9ff6e8ce9c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:05.149413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ed517387-2870-4829-a0c3-9ff6e8ce9c61 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:05.150869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ed517387-2870-4829-a0c3-9ff6e8ce9c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:05.166433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204e96-b409-4236-95ff-1a3a8b85af04 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:05.172744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:05.173659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:05.173776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:05.174122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] PATH_INFO: `/v3/users/6be308610d1f4750a9764abe8f2b0f27` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:05.175385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be308610d1f4750a9764abe8f2b0f27)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:05.177420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:05.265255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1058/2123] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:34:05.273376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be308610d1f4750a9764abe8f2b0f27'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:05.289723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be308610d1f4750a9764abe8f2b0f27'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:05.305724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be308610d1f4750a9764abe8f2b0f27'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:05.308712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be308610d1f4750a9764abe8f2b0f27'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:05.310713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e65e8810-b767-4ba0-af27-3d228b685207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be308610d1f4750a9764abe8f2b0f27'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:05.333834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:05.350533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed517387-2870-4829-a0c3-9ff6e8ce9c61 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:05.354058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ed517387-2870-4829-a0c3-9ff6e8ce9c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:05.358538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1066/2124] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:34:04 2022] DELETE /identity/v3/users/6be308610d1f4750a9764abe8f2b0f27 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:05.363032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f87d-7bf8-4aea-b46c-83b829b7a300 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:05.363374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f87d-7bf8-4aea-b46c-83b829b7a300 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:05.363820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f87d-7bf8-4aea-b46c-83b829b7a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:05.375777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:05.409145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a972f87d-7bf8-4aea-b46c-83b829b7a300 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:05.410947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a972f87d-7bf8-4aea-b46c-83b829b7a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:05.490355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed517387-2870-4829-a0c3-9ff6e8ce9c61 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:05.527515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1067/2125] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:05.534919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f87d-7bf8-4aea-b46c-83b829b7a300 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:05.536455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a972f87d-7bf8-4aea-b46c-83b829b7a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:05.608295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054c3d9-7bf4-489a-aaa1-faea539e45cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:05.609041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c3d9-7bf4-489a-aaa1-faea539e45cb service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:05.609267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c3d9-7bf4-489a-aaa1-faea539e45cb service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:05.609546 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c3d9-7bf4-489a-aaa1-faea539e45cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:05.612211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b054c3d9-7bf4-489a-aaa1-faea539e45cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:05.628225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f87d-7bf8-4aea-b46c-83b829b7a300 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:05.633251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:05.634765 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:05.635511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:05.635930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:05.649626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:05.651725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:05.666933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1068/2126] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:34:05.709578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054c3d9-7bf4-489a-aaa1-faea539e45cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:05.711226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054c3d9-7bf4-489a-aaa1-faea539e45cb service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:05.744677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1059/2127] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:34:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:34:06.408470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:06.410074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:06.442053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c2855-583d-41a5-95d0-da1a9c8e16e2 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:06.449276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:06.450088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:06.453349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:06.453667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] PATH_INFO: `/v3/projects/ec0a8582517e4234be416fbb120c29c2` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:06.455204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0a8582517e4234be416fbb120c29c2)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:06.457410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:06.574925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0a8582517e4234be416fbb120c29c2', 'request_id': 'req-3b71905f-566b-4989-a4c2-1f4fb3845eaf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:06.592074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0a8582517e4234be416fbb120c29c2', 'request_id': 'req-3b71905f-566b-4989-a4c2-1f4fb3845eaf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:06.624669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0a8582517e4234be416fbb120c29c2', 'request_id': 'req-3b71905f-566b-4989-a4c2-1f4fb3845eaf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:06.651408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] The token cache is being invalidate because project ec0a8582517e4234be416fbb120c29c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:34:06.651994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:06.653152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3b71905f-566b-4989-a4c2-1f4fb3845eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:06.662048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1069/2128] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:34:06 2022] DELETE /identity/v3/projects/ec0a8582517e4234be416fbb120c29c2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:06.664790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486e589-bf64-4c87-aa49-240f2433f26d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:06.666073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486e589-bf64-4c87-aa49-240f2433f26d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:06.666623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486e589-bf64-4c87-aa49-240f2433f26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:06.717555 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8486e589-bf64-4c87-aa49-240f2433f26d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:06.719052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8486e589-bf64-4c87-aa49-240f2433f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:06.865971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:06.893346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1060/2129] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:06.902110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14fc6e-90b8-4de4-b2eb-ae3175da70f4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:06.902678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14fc6e-90b8-4de4-b2eb-ae3175da70f4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:06.903012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14fc6e-90b8-4de4-b2eb-ae3175da70f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:06.929724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3b14fc6e-90b8-4de4-b2eb-ae3175da70f4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:06.931510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3b14fc6e-90b8-4de4-b2eb-ae3175da70f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:06.948658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1070/2130] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:06.950060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486e589-bf64-4c87-aa49-240f2433f26d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:06.963108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486e589-bf64-4c87-aa49-240f2433f26d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:06.969329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:06.970113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:06.970544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:06.971067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:06.971995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:34:06.971995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:06.973928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:06.993367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14fc6e-90b8-4de4-b2eb-ae3175da70f4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:07.004203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1061/2131] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:34:07.005188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14fc6e-90b8-4de4-b2eb-ae3175da70f4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:07.020439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3e45-5542-4e81-8232-58e7c546de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:07.020439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3e45-5542-4e81-8232-58e7c546de13 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:07.020439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3e45-5542-4e81-8232-58e7c546de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:07.020439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3e45-5542-4e81-8232-58e7c546de13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:07.020970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c3e45-5542-4e81-8232-58e7c546de13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:07.020970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c3e45-5542-4e81-8232-58e7c546de13 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:07.080280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:07.111291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1071/2132] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:34:06 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:07.112814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:07.139210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae6b36-949f-404f-a574-1ab072e754c8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:07.333021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a9e25-0fdf-4bbf-be22-a7030a9232d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:07.333968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9e25-0fdf-4bbf-be22-a7030a9232d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:07.334403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9e25-0fdf-4bbf-be22-a7030a9232d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:07.334871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9e25-0fdf-4bbf-be22-a7030a9232d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:07.335789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a9e25-0fdf-4bbf-be22-a7030a9232d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:07.355349 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a9e25-0fdf-4bbf-be22-a7030a9232d9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:07.413287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1062/2133] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:34:07 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:07.416974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3e45-5542-4e81-8232-58e7c546de13 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:07.439387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3e45-5542-4e81-8232-58e7c546de13 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:07.454236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b72324-90fa-417f-aee3-3916185eca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:07.454889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b72324-90fa-417f-aee3-3916185eca6a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:07.455167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b72324-90fa-417f-aee3-3916185eca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:07.455438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b72324-90fa-417f-aee3-3916185eca6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:07.456105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b72324-90fa-417f-aee3-3916185eca6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:07.470822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b72324-90fa-417f-aee3-3916185eca6a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:07.498871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1072/2134] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:07.503554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a9e25-0fdf-4bbf-be22-a7030a9232d9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:07.522657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a9e25-0fdf-4bbf-be22-a7030a9232d9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:07.530252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45815920-c691-4ef8-aebe-cd3b4ca99cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:07.531180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815920-c691-4ef8-aebe-cd3b4ca99cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:07.531539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815920-c691-4ef8-aebe-cd3b4ca99cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:07.531938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815920-c691-4ef8-aebe-cd3b4ca99cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:07.532850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45815920-c691-4ef8-aebe-cd3b4ca99cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:07.535350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45815920-c691-4ef8-aebe-cd3b4ca99cdd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:07.559053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1063/2135] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:07.562810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b72324-90fa-417f-aee3-3916185eca6a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:07.589422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b72324-90fa-417f-aee3-3916185eca6a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:07.607409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b51d-9f0c-4689-93ce-2c380d9d8eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:07.608258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b51d-9f0c-4689-93ce-2c380d9d8eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:07.609073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b51d-9f0c-4689-93ce-2c380d9d8eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:07.611473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b51d-9f0c-4689-93ce-2c380d9d8eaa admin admin] PATH_INFO: `/v3/projects/0f4abe2ef9d6483980d98d7c9000267a/users/5f08867f2d1941968c52cb2432bc3d1b/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:07.665059 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b51d-9f0c-4689-93ce-2c380d9d8eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4abe2ef9d6483980d98d7c9000267a, user_id=5f08867f2d1941968c52cb2432bc3d1b, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:07.670013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b51d-9f0c-4689-93ce-2c380d9d8eaa admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:07.738551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1073/2136] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:07 2022] PUT /identity/v3/projects/0f4abe2ef9d6483980d98d7c9000267a/users/5f08867f2d1941968c52cb2432bc3d1b/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:34:07.749846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3ed0-1e84-430a-8e7e-a33e262e7770 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:07.750444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3ed0-1e84-430a-8e7e-a33e262e7770 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:07.752304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3ed0-1e84-430a-8e7e-a33e262e7770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:07.847998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-074a3ed0-1e84-430a-8e7e-a33e262e7770 None None] MFA Rules not processed for user `5f08867f2d1941968c52cb2432bc3d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:07.850485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-074a3ed0-1e84-430a-8e7e-a33e262e7770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:08.065410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b51d-9f0c-4689-93ce-2c380d9d8eaa admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:08.070729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1064/2137] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:08.206705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b51d-9f0c-4689-93ce-2c380d9d8eaa admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:08.213682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f2971-6084-4654-b55c-a54d3c202f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:08.214597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f2971-6084-4654-b55c-a54d3c202f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:08.215026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f2971-6084-4654-b55c-a54d3c202f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:08.215421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f2971-6084-4654-b55c-a54d3c202f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:08.216673 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f2971-6084-4654-b55c-a54d3c202f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:08.220429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f2971-6084-4654-b55c-a54d3c202f9e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:08.307705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a3ed0-1e84-430a-8e7e-a33e262e7770 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:08.316595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1074/2138] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:34:08 2022] POST /identity/v3/projects => generated 373 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:08.327765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a3ed0-1e84-430a-8e7e-a33e262e7770 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:08.413335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:08.452668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f219-26c7-46f8-98da-8790bbaefe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:08.453584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f219-26c7-46f8-98da-8790bbaefe0f admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:08.454279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f219-26c7-46f8-98da-8790bbaefe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:08.454779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952f219-26c7-46f8-98da-8790bbaefe0f admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:08.456215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952f219-26c7-46f8-98da-8790bbaefe0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:08.458756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952f219-26c7-46f8-98da-8790bbaefe0f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:08.510625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1065/2139] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:34:08 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:34:08.513241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f2971-6084-4654-b55c-a54d3c202f9e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:08.528858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f2971-6084-4654-b55c-a54d3c202f9e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:08.542388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5467a-8487-4a34-80ef-826508c30639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:08.544777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5467a-8487-4a34-80ef-826508c30639 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:08.546849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5467a-8487-4a34-80ef-826508c30639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:08.547220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5467a-8487-4a34-80ef-826508c30639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:08.548280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5467a-8487-4a34-80ef-826508c30639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:08.552002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5467a-8487-4a34-80ef-826508c30639 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:08.601935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1075/2140] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:08.602444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f219-26c7-46f8-98da-8790bbaefe0f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:08.619665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952f219-26c7-46f8-98da-8790bbaefe0f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:08.629573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:08.630291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:08.630576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:08.630855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] PATH_INFO: `/v3/projects/4f0aef0f42394a849545c17ba6b6fa36/users/79eaf0b69d974c97b623e157d00ba915/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:08.695062 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0aef0f42394a849545c17ba6b6fa36, user_id=79eaf0b69d974c97b623e157d00ba915, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:08.705380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:08.770542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5467a-8487-4a34-80ef-826508c30639 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:08.780880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1066/2141] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:08 2022] PUT /identity/v3/projects/4f0aef0f42394a849545c17ba6b6fa36/users/79eaf0b69d974c97b623e157d00ba915/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:08.784498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5467a-8487-4a34-80ef-826508c30639 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:08.881518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:08.887619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:08.947505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7423c-8836-4fc2-a7c2-dc5140c8972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:08.948687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7423c-8836-4fc2-a7c2-dc5140c8972d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:08.950268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7423c-8836-4fc2-a7c2-dc5140c8972d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:08.950723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7423c-8836-4fc2-a7c2-dc5140c8972d admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:08.953455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7423c-8836-4fc2-a7c2-dc5140c8972d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:08.955813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7423c-8836-4fc2-a7c2-dc5140c8972d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:08.991729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1076/2142] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:09.010830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7423c-8836-4fc2-a7c2-dc5140c8972d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:09.025551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7423c-8836-4fc2-a7c2-dc5140c8972d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:09.046461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc389f-0261-49f7-a240-489b2a971ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:09.048748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc389f-0261-49f7-a240-489b2a971ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:09.050281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc389f-0261-49f7-a240-489b2a971ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:09.051665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc389f-0261-49f7-a240-489b2a971ffb admin admin] PATH_INFO: `/v3/projects/4f0aef0f42394a849545c17ba6b6fa36/users/79eaf0b69d974c97b623e157d00ba915/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:09.055543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc389f-0261-49f7-a240-489b2a971ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0aef0f42394a849545c17ba6b6fa36, user_id=79eaf0b69d974c97b623e157d00ba915, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:09.063459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc389f-0261-49f7-a240-489b2a971ffb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:09.067784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32add4b-46e8-40c1-8008-6d51b0d1d291 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:09.076492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:09.080535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:09.081821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:09.082028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:09.091130 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:09.104272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1077/2143] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:08 2022] PUT /identity/v3/projects/4f0aef0f42394a849545c17ba6b6fa36/users/79eaf0b69d974c97b623e157d00ba915/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:09.115050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886501e-1337-4f6e-a042-ee828ff35184 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:09.115327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886501e-1337-4f6e-a042-ee828ff35184 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:09.115697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886501e-1337-4f6e-a042-ee828ff35184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:09.189923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0886501e-1337-4f6e-a042-ee828ff35184 None None] MFA Rules not processed for user `79eaf0b69d974c97b623e157d00ba915`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:09.191284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0886501e-1337-4f6e-a042-ee828ff35184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:09.201550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:09.293202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:09.294738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:09.342517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1067/2144] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:34:09.433651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1078/2145] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:34:09.444459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:09.446052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:09.476914 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448c18a-e8d1-4152-8898-2754f474eaff service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:09.605217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeabf5f-7fbd-4c85-833a-8c6db67c3ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:09.605695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeabf5f-7fbd-4c85-833a-8c6db67c3ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:09.605977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeabf5f-7fbd-4c85-833a-8c6db67c3ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:09.606247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeabf5f-7fbd-4c85-833a-8c6db67c3ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:09.645879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:09.751795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeabf5f-7fbd-4c85-833a-8c6db67c3ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:09.756158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeabf5f-7fbd-4c85-833a-8c6db67c3ac9 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:09.780920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1068/2146] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:13.043565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886501e-1337-4f6e-a042-ee828ff35184 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:13.285864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886501e-1337-4f6e-a042-ee828ff35184 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:13.293843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:13.298330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:13.300051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:13.300823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] PATH_INFO: `/v3/users/5f08867f2d1941968c52cb2432bc3d1b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:13.305533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f08867f2d1941968c52cb2432bc3d1b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:13.365842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:13.554647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f08867f2d1941968c52cb2432bc3d1b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:13.603036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f08867f2d1941968c52cb2432bc3d1b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:13.633232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f08867f2d1941968c52cb2432bc3d1b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:13.633232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f08867f2d1941968c52cb2432bc3d1b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:13.633232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f08867f2d1941968c52cb2432bc3d1b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:13.667112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1079/2147] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:34:13 2022] DELETE /identity/v3/users/5f08867f2d1941968c52cb2432bc3d1b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:13.671667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddd47-665f-415c-b4b7-89cd6c24b4bc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:13.672834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddd47-665f-415c-b4b7-89cd6c24b4bc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:13.673637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddd47-665f-415c-b4b7-89cd6c24b4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:13.715294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4ceddd47-665f-415c-b4b7-89cd6c24b4bc None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:13.716618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4ceddd47-665f-415c-b4b7-89cd6c24b4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:13.898673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1069/2148] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:13.936250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:13.937858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:14.019009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:14.130226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c99de-82d4-4083-9c0d-164f761a95a6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:14.145391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0977eb7-0f88-4ec3-b322-9588e0284f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:14.146490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0977eb7-0f88-4ec3-b322-9588e0284f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:14.148056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0977eb7-0f88-4ec3-b322-9588e0284f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:14.148498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0977eb7-0f88-4ec3-b322-9588e0284f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:14.180907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0977eb7-0f88-4ec3-b322-9588e0284f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:14.184903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0977eb7-0f88-4ec3-b322-9588e0284f85 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:14.209543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1080/2149] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:15.773160 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddd47-665f-415c-b4b7-89cd6c24b4bc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:15.777345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4ceddd47-665f-415c-b4b7-89cd6c24b4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:15.812583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddd47-665f-415c-b4b7-89cd6c24b4bc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:15.835675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:15.836543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:15.837002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:15.837824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] PATH_INFO: `/v3/projects/0f4abe2ef9d6483980d98d7c9000267a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:15.839383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4abe2ef9d6483980d98d7c9000267a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:15.843400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:15.933434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4abe2ef9d6483980d98d7c9000267a', 'request_id': 'req-08e8caff-8065-4fce-98ec-5880de6fcad9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:15.943017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4abe2ef9d6483980d98d7c9000267a', 'request_id': 'req-08e8caff-8065-4fce-98ec-5880de6fcad9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:15.958448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4abe2ef9d6483980d98d7c9000267a', 'request_id': 'req-08e8caff-8065-4fce-98ec-5880de6fcad9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:15.974462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] The token cache is being invalidate because project 0f4abe2ef9d6483980d98d7c9000267a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:34:15.974801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:15.975480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:15.977447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1070/2150] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:34:15 2022] DELETE /identity/v3/projects/0f4abe2ef9d6483980d98d7c9000267a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:15.982873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0977eb7-0f88-4ec3-b322-9588e0284f85 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:15.996587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0977eb7-0f88-4ec3-b322-9588e0284f85 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:16.088559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:16.089584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:16.090004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:16.090372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] PATH_INFO: `/v3/users/79eaf0b69d974c97b623e157d00ba915` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:16.091829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=79eaf0b69d974c97b623e157d00ba915)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:16.098064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:16.205423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79eaf0b69d974c97b623e157d00ba915'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:16.239288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79eaf0b69d974c97b623e157d00ba915'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:16.263532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79eaf0b69d974c97b623e157d00ba915'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:16.264872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79eaf0b69d974c97b623e157d00ba915'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:16.266489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-86dc6eb2-bbe4-44e0-80c3-fd3c989448ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79eaf0b69d974c97b623e157d00ba915'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:16.296691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1081/2151] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:34:15 2022] DELETE /identity/v3/users/79eaf0b69d974c97b623e157d00ba915 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:17.044061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:17.046149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:17.092493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8caff-8065-4fce-98ec-5880de6fcad9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:17.170645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:17.215047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:17.215934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:17.216406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:17.216804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] PATH_INFO: `/v3/projects/4f0aef0f42394a849545c17ba6b6fa36` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:17.218240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0aef0f42394a849545c17ba6b6fa36)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:17.221649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:17.328979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0aef0f42394a849545c17ba6b6fa36', 'request_id': 'req-b989257e-53ae-45d0-84d6-97716fb183ff'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:17.359293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0aef0f42394a849545c17ba6b6fa36', 'request_id': 'req-b989257e-53ae-45d0-84d6-97716fb183ff'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:17.393804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0aef0f42394a849545c17ba6b6fa36', 'request_id': 'req-b989257e-53ae-45d0-84d6-97716fb183ff'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:17.447304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] The token cache is being invalidate because project 4f0aef0f42394a849545c17ba6b6fa36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:34:17.447932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:17.448900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b989257e-53ae-45d0-84d6-97716fb183ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:17.451010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1071/2152] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:34:17 2022] DELETE /identity/v3/projects/4f0aef0f42394a849545c17ba6b6fa36 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:17.457231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa654ff-ef4a-4a92-aab2-446f2e3fd678 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:17.457916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa654ff-ef4a-4a92-aab2-446f2e3fd678 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:17.457916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa654ff-ef4a-4a92-aab2-446f2e3fd678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:17.502045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7aa654ff-ef4a-4a92-aab2-446f2e3fd678 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:17.503290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7aa654ff-ef4a-4a92-aab2-446f2e3fd678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:17.571912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:17.611268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1082/2153] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:17.612890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc713-8401-4fcc-a297-ebc3ac65d7a4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:17.613435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc713-8401-4fcc-a297-ebc3ac65d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:17.613775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc713-8401-4fcc-a297-ebc3ac65d7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:17.638496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-99afc713-8401-4fcc-a297-ebc3ac65d7a4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:17.641004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-99afc713-8401-4fcc-a297-ebc3ac65d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:17.654899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1072/2154] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:34:17.657028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa654ff-ef4a-4a92-aab2-446f2e3fd678 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:17.670593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa654ff-ef4a-4a92-aab2-446f2e3fd678 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:17.675630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:17.676285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:17.676601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:17.676873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:17.677542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:34:17.677881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:17.679688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:17.697297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1083/2155] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:34:17.702204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc713-8401-4fcc-a297-ebc3ac65d7a4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:17.716989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc713-8401-4fcc-a297-ebc3ac65d7a4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:17.722571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feefacd-36d1-412d-8c46-bd6b6d037d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:17.723521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feefacd-36d1-412d-8c46-bd6b6d037d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:17.723993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feefacd-36d1-412d-8c46-bd6b6d037d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:17.724529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feefacd-36d1-412d-8c46-bd6b6d037d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:17.725502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feefacd-36d1-412d-8c46-bd6b6d037d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:17.728420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feefacd-36d1-412d-8c46-bd6b6d037d0e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:17.778849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1073/2156] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:34:17 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:34:17.783845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:17.797320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961bc2-0ab8-4e9c-818e-aa6cb00d3cb2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:17.880896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fe2c7-c842-4b77-86c5-cdf56eb50839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:17.881997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe2c7-c842-4b77-86c5-cdf56eb50839 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:17.881997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe2c7-c842-4b77-86c5-cdf56eb50839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:17.882803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe2c7-c842-4b77-86c5-cdf56eb50839 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:17.883717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fe2c7-c842-4b77-86c5-cdf56eb50839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:17.886273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fe2c7-c842-4b77-86c5-cdf56eb50839 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:17.941319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1084/2157] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:34:17 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:17.945646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feefacd-36d1-412d-8c46-bd6b6d037d0e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:17.984053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feefacd-36d1-412d-8c46-bd6b6d037d0e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:18.002875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a0ca-7bcd-4df5-97c4-3f9bdee9c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:18.004272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a0ca-7bcd-4df5-97c4-3f9bdee9c3db admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:18.005008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a0ca-7bcd-4df5-97c4-3f9bdee9c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:18.005742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a0ca-7bcd-4df5-97c4-3f9bdee9c3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:18.007243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a0ca-7bcd-4df5-97c4-3f9bdee9c3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:18.011035 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a0ca-7bcd-4df5-97c4-3f9bdee9c3db admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:18.045545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1074/2158] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:34:18.050028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fe2c7-c842-4b77-86c5-cdf56eb50839 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:18.080921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fe2c7-c842-4b77-86c5-cdf56eb50839 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:18.090292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61cfbb-5cfc-4c05-85e9-d531c16f66fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:18.092021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61cfbb-5cfc-4c05-85e9-d531c16f66fb admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:18.092932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61cfbb-5cfc-4c05-85e9-d531c16f66fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:18.093757 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61cfbb-5cfc-4c05-85e9-d531c16f66fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:18.130391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61cfbb-5cfc-4c05-85e9-d531c16f66fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:18.153830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61cfbb-5cfc-4c05-85e9-d531c16f66fb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:18.232645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1085/2159] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:18.242552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a0ca-7bcd-4df5-97c4-3f9bdee9c3db admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:18.294062 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a0ca-7bcd-4df5-97c4-3f9bdee9c3db admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:18.307552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:18.308268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:18.308590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:18.308874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] PATH_INFO: `/v3/projects/161ef8b6cc294544869ff92d65c7180f/users/2b12b04d85d84994a29f1fe434bbd0dc/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:18.362948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=161ef8b6cc294544869ff92d65c7180f, user_id=2b12b04d85d84994a29f1fe434bbd0dc, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:18.365998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:18.403436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1075/2160] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:18 2022] PUT /identity/v3/projects/161ef8b6cc294544869ff92d65c7180f/users/2b12b04d85d84994a29f1fe434bbd0dc/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:18.412171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9026e6-9d24-4d8f-8dba-4d777de2dafa None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:18.413015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9026e6-9d24-4d8f-8dba-4d777de2dafa None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:18.413720 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9026e6-9d24-4d8f-8dba-4d777de2dafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:18.461493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-de9026e6-9d24-4d8f-8dba-4d777de2dafa None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:18.463882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-de9026e6-9d24-4d8f-8dba-4d777de2dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:18.580305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1086/2161] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:18.591610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:18.594390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:18.715956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43551b48-d504-4e62-bfbd-badd7e5450ca admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:18.722175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:18.723189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:18.723659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:18.724368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:18.745792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:18.748654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:18.775884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1076/2162] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:20.526220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6643-22c9-495a-9c7e-b24c0927b7d2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:20.526694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6643-22c9-495a-9c7e-b24c0927b7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:20.526790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6643-22c9-495a-9c7e-b24c0927b7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:20.607216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-486d6643-22c9-495a-9c7e-b24c0927b7d2 None None] MFA Rules not processed for user `2b12b04d85d84994a29f1fe434bbd0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:20.617891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-486d6643-22c9-495a-9c7e-b24c0927b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:20.715881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:20.767851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1087/2163] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:20.787800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:20.791800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:20.817533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:20.910139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e206-3956-434a-a0d3-91e72e84e28c service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:20.916596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f727671-6f52-403e-a826-7506d2c08a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:20.917654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f727671-6f52-403e-a826-7506d2c08a10 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:20.918135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f727671-6f52-403e-a826-7506d2c08a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:20.920620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f727671-6f52-403e-a826-7506d2c08a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:20.936176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f727671-6f52-403e-a826-7506d2c08a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:20.939326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f727671-6f52-403e-a826-7506d2c08a10 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:20.974032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1077/2164] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:22.677193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54a2c-958c-44b0-8796-386eb5443e60 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:22.677890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54a2c-958c-44b0-8796-386eb5443e60 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:22.678086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54a2c-958c-44b0-8796-386eb5443e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:22.706897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8fc54a2c-958c-44b0-8796-386eb5443e60 None None] MFA Rules not processed for user `2b12b04d85d84994a29f1fe434bbd0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:22.715947 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8fc54a2c-958c-44b0-8796-386eb5443e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:22.719606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1088/2165] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:22.788184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e6ca1-4d3b-4a6f-a8ab-3a38e10f83c8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:22.788731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e6ca1-4d3b-4a6f-a8ab-3a38e10f83c8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:22.788819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e6ca1-4d3b-4a6f-a8ab-3a38e10f83c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:22.822238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6f6e6ca1-4d3b-4a6f-a8ab-3a38e10f83c8 None None] MFA Rules not processed for user `151a9b6135264c0fa0f272a9115bf9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:22.824655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6f6e6ca1-4d3b-4a6f-a8ab-3a38e10f83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:22.923628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1078/2166] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:29.005084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab4ff-e3f6-47a7-8272-a998890d5c1c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:29.005911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab4ff-e3f6-47a7-8272-a998890d5c1c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:29.006100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab4ff-e3f6-47a7-8272-a998890d5c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:29.050446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e27ab4ff-e3f6-47a7-8272-a998890d5c1c None None] MFA Rules not processed for user `2c871cad6d394173b2b43fc89940f1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:29.054053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e27ab4ff-e3f6-47a7-8272-a998890d5c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:29.230546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1089/2167] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:29.621809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346454e-0d3a-4d45-ad5c-c2fc3b5932e3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:29.622693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346454e-0d3a-4d45-ad5c-c2fc3b5932e3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:29.622693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346454e-0d3a-4d45-ad5c-c2fc3b5932e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:29.648869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7346454e-0d3a-4d45-ad5c-c2fc3b5932e3 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:29.650797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7346454e-0d3a-4d45-ad5c-c2fc3b5932e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:29.766488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1079/2168] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:29.787581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ab4ff-e3f6-47a7-8272-a998890d5c1c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:29.789248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e27ab4ff-e3f6-47a7-8272-a998890d5c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:29.946611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ab4ff-e3f6-47a7-8272-a998890d5c1c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:29.960466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1156-a5d1-453d-8025-342feb2b8d9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:29.961430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1156-a5d1-453d-8025-342feb2b8d9c service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:29.961782 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1156-a5d1-453d-8025-342feb2b8d9c service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:29.962266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1156-a5d1-453d-8025-342feb2b8d9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:29.977299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be1156-a5d1-453d-8025-342feb2b8d9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:29.979014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be1156-a5d1-453d-8025-342feb2b8d9c service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:29.993791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1090/2169] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:34:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:34:38.321068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346454e-0d3a-4d45-ad5c-c2fc3b5932e3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:38.322698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7346454e-0d3a-4d45-ad5c-c2fc3b5932e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:38.351432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346454e-0d3a-4d45-ad5c-c2fc3b5932e3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:38.357018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:38.357760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:38.358131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:38.358412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] PATH_INFO: `/v3/users/1849456f299044169b9a78dfe22b5e7e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:38.360456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1849456f299044169b9a78dfe22b5e7e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:38.361842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:38.456972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1849456f299044169b9a78dfe22b5e7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:38.468965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1849456f299044169b9a78dfe22b5e7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:38.469911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1849456f299044169b9a78dfe22b5e7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:38.470540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1849456f299044169b9a78dfe22b5e7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:38.472270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:38.480941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1849456f299044169b9a78dfe22b5e7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:38.517891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1080/2170] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:34:38 2022] DELETE /identity/v3/users/1849456f299044169b9a78dfe22b5e7e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:38.793341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1156-a5d1-453d-8025-342feb2b8d9c service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:38.827426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1156-a5d1-453d-8025-342feb2b8d9c service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:38.974734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:38.975164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:38.975414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:38.975690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] PATH_INFO: `/v3/projects/ef385c20f8cc4ad6aa2406356d8e0939` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:38.977315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef385c20f8cc4ad6aa2406356d8e0939)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:38.979245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:39.009499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:39.066545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef385c20f8cc4ad6aa2406356d8e0939', 'request_id': 'req-ae54251d-1da3-4ec4-a0de-7371cc3c9820'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.096405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef385c20f8cc4ad6aa2406356d8e0939', 'request_id': 'req-ae54251d-1da3-4ec4-a0de-7371cc3c9820'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.111264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef385c20f8cc4ad6aa2406356d8e0939', 'request_id': 'req-ae54251d-1da3-4ec4-a0de-7371cc3c9820'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.126723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] The token cache is being invalidate because project ef385c20f8cc4ad6aa2406356d8e0939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:34:39.127162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.127977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.144706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1091/2171] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:34:38 2022] DELETE /identity/v3/projects/ef385c20f8cc4ad6aa2406356d8e0939 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:39.149700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:39.151451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:39.172955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298950e-d2fb-47e0-afcc-9db48f5c5196 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:39.286271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:39.287088 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:39.287384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:39.287665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] PATH_INFO: `/v3/users/1828276ad66d4c9390dfa36bb4aa0bbc` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:39.289068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1828276ad66d4c9390dfa36bb4aa0bbc)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:39.291052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:39.364133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1828276ad66d4c9390dfa36bb4aa0bbc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.400565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1828276ad66d4c9390dfa36bb4aa0bbc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.400847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1828276ad66d4c9390dfa36bb4aa0bbc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.401562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1828276ad66d4c9390dfa36bb4aa0bbc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.410592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6fbd1f4-1b04-44bd-93ea-d82eb880d319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1828276ad66d4c9390dfa36bb4aa0bbc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.432855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1081/2172] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:34:39 2022] DELETE /identity/v3/users/1828276ad66d4c9390dfa36bb4aa0bbc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:39.726894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:39.728358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:39.744348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54251d-1da3-4ec4-a0de-7371cc3c9820 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:39.811296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:39.812040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:39.812269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:39.812716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] PATH_INFO: `/v3/projects/62b13090709c4dfa9237cb5aee55c36b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:39.813824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b13090709c4dfa9237cb5aee55c36b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:39.815811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:39.887951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b13090709c4dfa9237cb5aee55c36b', 'request_id': 'req-41e8bcd9-73be-4973-b631-5518c99862be'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.898760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b13090709c4dfa9237cb5aee55c36b', 'request_id': 'req-41e8bcd9-73be-4973-b631-5518c99862be'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.909158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b13090709c4dfa9237cb5aee55c36b', 'request_id': 'req-41e8bcd9-73be-4973-b631-5518c99862be'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.929729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] The token cache is being invalidate because project 62b13090709c4dfa9237cb5aee55c36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:34:39.930018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.930790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-41e8bcd9-73be-4973-b631-5518c99862be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:39.932434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1092/2173] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:34:39 2022] DELETE /identity/v3/projects/62b13090709c4dfa9237cb5aee55c36b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:39.938587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf82d-25b6-4a14-8be9-074029f40a8f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:39.938864 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf82d-25b6-4a14-8be9-074029f40a8f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:39.939329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf82d-25b6-4a14-8be9-074029f40a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:39.963575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bc9bf82d-25b6-4a14-8be9-074029f40a8f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:39.964968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bc9bf82d-25b6-4a14-8be9-074029f40a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:40.023191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:40.042325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1082/2174] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:40.051659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962de2f-04c2-4d4c-ad03-568d7d02a93f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.052089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962de2f-04c2-4d4c-ad03-568d7d02a93f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.052502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962de2f-04c2-4d4c-ad03-568d7d02a93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.073659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0962de2f-04c2-4d4c-ad03-568d7d02a93f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:40.074893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0962de2f-04c2-4d4c-ad03-568d7d02a93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:40.084012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1093/2175] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:40.088549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bf82d-25b6-4a14-8be9-074029f40a8f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:40.101344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bf82d-25b6-4a14-8be9-074029f40a8f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:40.106653 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:40.107135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.107417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.107690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.108363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:34:40.108704 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:40.110490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:40.128639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1083/2176] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:34:40.133196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962de2f-04c2-4d4c-ad03-568d7d02a93f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:40.152513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962de2f-04c2-4d4c-ad03-568d7d02a93f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:40.167775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d72e6-af39-466e-bcf1-5631b71da41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:40.168867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d72e6-af39-466e-bcf1-5631b71da41a admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.169529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d72e6-af39-466e-bcf1-5631b71da41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.169892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d72e6-af39-466e-bcf1-5631b71da41a admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.171748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d72e6-af39-466e-bcf1-5631b71da41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:40.176577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d72e6-af39-466e-bcf1-5631b71da41a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:40.225730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:40.241558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1094/2177] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:34:40 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:40.242887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:40.258760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f677e-61eb-4be0-bfe7-0f33a6dfb758 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:40.362661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506739a-23e0-4a81-b52c-46d1d1ace3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:40.364819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506739a-23e0-4a81-b52c-46d1d1ace3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.365760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506739a-23e0-4a81-b52c-46d1d1ace3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.366264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506739a-23e0-4a81-b52c-46d1d1ace3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.367539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506739a-23e0-4a81-b52c-46d1d1ace3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:40.371417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506739a-23e0-4a81-b52c-46d1d1ace3e2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:40.418988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1084/2178] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:34:40 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:34:40.423837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d72e6-af39-466e-bcf1-5631b71da41a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:40.440499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d72e6-af39-466e-bcf1-5631b71da41a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:40.451619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bc62b-b576-4976-9d15-343ef28b4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:40.452363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc62b-b576-4976-9d15-343ef28b4af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.452777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc62b-b576-4976-9d15-343ef28b4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.453238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc62b-b576-4976-9d15-343ef28b4af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.454451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bc62b-b576-4976-9d15-343ef28b4af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:40.456309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bc62b-b576-4976-9d15-343ef28b4af0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:40.471169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1095/2179] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:40.477223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506739a-23e0-4a81-b52c-46d1d1ace3e2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:40.496578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506739a-23e0-4a81-b52c-46d1d1ace3e2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:40.505390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3a39b-5a53-4d33-8ef2-819ae23491c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:40.506430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a39b-5a53-4d33-8ef2-819ae23491c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.506901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a39b-5a53-4d33-8ef2-819ae23491c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.507385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a39b-5a53-4d33-8ef2-819ae23491c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.508611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3a39b-5a53-4d33-8ef2-819ae23491c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:40.512144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3a39b-5a53-4d33-8ef2-819ae23491c8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:40.534264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1085/2180] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:40.540542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bc62b-b576-4976-9d15-343ef28b4af0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:40.563554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bc62b-b576-4976-9d15-343ef28b4af0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:40.585834 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3fa54-56a0-44fa-84c1-75082fd99460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:40.587157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3fa54-56a0-44fa-84c1-75082fd99460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.587354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3fa54-56a0-44fa-84c1-75082fd99460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.587545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3fa54-56a0-44fa-84c1-75082fd99460 admin admin] PATH_INFO: `/v3/projects/3969dcf93bf746118820907de777f3df/users/53ad30175f2e458f8749251436600e69/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.607889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3fa54-56a0-44fa-84c1-75082fd99460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3969dcf93bf746118820907de777f3df, user_id=53ad30175f2e458f8749251436600e69, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:40.611022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3fa54-56a0-44fa-84c1-75082fd99460 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:40.637775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1096/2181] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:40 2022] PUT /identity/v3/projects/3969dcf93bf746118820907de777f3df/users/53ad30175f2e458f8749251436600e69/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:40.650301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1d3ef-cded-4da0-a8ed-14b7b4b40250 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.650621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1d3ef-cded-4da0-a8ed-14b7b4b40250 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.650867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1d3ef-cded-4da0-a8ed-14b7b4b40250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.718937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dff1d3ef-cded-4da0-a8ed-14b7b4b40250 None None] MFA Rules not processed for user `53ad30175f2e458f8749251436600e69`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:40.721066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dff1d3ef-cded-4da0-a8ed-14b7b4b40250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:40.843905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1086/2182] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:40.848677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3fa54-56a0-44fa-84c1-75082fd99460 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:40.983505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3fa54-56a0-44fa-84c1-75082fd99460 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:40.992581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c480bd-610e-4952-b4f8-1baf3e7b4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:40.993636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c480bd-610e-4952-b4f8-1baf3e7b4de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:40.994246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c480bd-610e-4952-b4f8-1baf3e7b4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:40.994568 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c480bd-610e-4952-b4f8-1baf3e7b4de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:40.995726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c480bd-610e-4952-b4f8-1baf3e7b4de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:40.999445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c480bd-610e-4952-b4f8-1baf3e7b4de5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:41.053981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1097/2183] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:34:40 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:34:41.058742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1d3ef-cded-4da0-a8ed-14b7b4b40250 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:41.072620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1d3ef-cded-4da0-a8ed-14b7b4b40250 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:41.155675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:41.188026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d162ed1-130d-4036-ae22-d5b4d6a976e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:41.189528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d162ed1-130d-4036-ae22-d5b4d6a976e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:41.190129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d162ed1-130d-4036-ae22-d5b4d6a976e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:41.191608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d162ed1-130d-4036-ae22-d5b4d6a976e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:41.192468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d162ed1-130d-4036-ae22-d5b4d6a976e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:41.197425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d162ed1-130d-4036-ae22-d5b4d6a976e6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:41.246800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1087/2184] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:34:41 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:41.248780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c480bd-610e-4952-b4f8-1baf3e7b4de5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:41.287597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c480bd-610e-4952-b4f8-1baf3e7b4de5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:41.303621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48134-01f5-4422-97b0-8576946ba37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:41.304256 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48134-01f5-4422-97b0-8576946ba37a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:41.304569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48134-01f5-4422-97b0-8576946ba37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:41.304835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48134-01f5-4422-97b0-8576946ba37a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:41.305696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48134-01f5-4422-97b0-8576946ba37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:41.307457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48134-01f5-4422-97b0-8576946ba37a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:41.325027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1098/2185] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:41.329456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d162ed1-130d-4036-ae22-d5b4d6a976e6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:41.351782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d162ed1-130d-4036-ae22-d5b4d6a976e6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:41.359024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebdc02-df70-4bcf-ba5a-2ac0d3797956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:41.360239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdc02-df70-4bcf-ba5a-2ac0d3797956 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:41.360666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdc02-df70-4bcf-ba5a-2ac0d3797956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:41.360857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdc02-df70-4bcf-ba5a-2ac0d3797956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:41.362667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebdc02-df70-4bcf-ba5a-2ac0d3797956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:41.364047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebdc02-df70-4bcf-ba5a-2ac0d3797956 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:41.376431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1088/2186] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:34:41.382005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48134-01f5-4422-97b0-8576946ba37a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:41.395735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48134-01f5-4422-97b0-8576946ba37a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:41.403301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6985ba0-b137-4a66-885d-31961e90aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:41.403787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6985ba0-b137-4a66-885d-31961e90aef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:41.403787 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6985ba0-b137-4a66-885d-31961e90aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:41.404165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6985ba0-b137-4a66-885d-31961e90aef7 admin admin] PATH_INFO: `/v3/projects/05c2513e711d4eb1bb470f5301de46ff/users/2c0d36e2c97a4fe4ad9dfcb19b8a9027/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:41.429387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6985ba0-b137-4a66-885d-31961e90aef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c2513e711d4eb1bb470f5301de46ff, user_id=2c0d36e2c97a4fe4ad9dfcb19b8a9027, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:41.433734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6985ba0-b137-4a66-885d-31961e90aef7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:41.450999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1099/2187] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:41 2022] PUT /identity/v3/projects/05c2513e711d4eb1bb470f5301de46ff/users/2c0d36e2c97a4fe4ad9dfcb19b8a9027/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:34:41.462313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d6906-ad87-47f7-9dfb-5f144257ad47 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:41.462974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d6906-ad87-47f7-9dfb-5f144257ad47 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:41.463571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d6906-ad87-47f7-9dfb-5f144257ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:41.497566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-959d6906-ad87-47f7-9dfb-5f144257ad47 None None] MFA Rules not processed for user `2c0d36e2c97a4fe4ad9dfcb19b8a9027`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:41.498998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-959d6906-ad87-47f7-9dfb-5f144257ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:41.576482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1089/2188] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:34:41.581477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6985ba0-b137-4a66-885d-31961e90aef7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:41.685832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6985ba0-b137-4a66-885d-31961e90aef7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:41.695166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26823f5c-cb9f-4385-92b3-e0a22bd0590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:41.696421 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26823f5c-cb9f-4385-92b3-e0a22bd0590e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:41.696833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26823f5c-cb9f-4385-92b3-e0a22bd0590e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:41.697285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26823f5c-cb9f-4385-92b3-e0a22bd0590e admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:41.698147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26823f5c-cb9f-4385-92b3-e0a22bd0590e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:41.714020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26823f5c-cb9f-4385-92b3-e0a22bd0590e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:41.774651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:41.792876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1100/2189] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:34:41 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:41.797236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d6906-ad87-47f7-9dfb-5f144257ad47 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:41.823420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d6906-ad87-47f7-9dfb-5f144257ad47 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:41.925837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a874d7c-0e20-42a3-b5cd-8778072e05ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:41.926837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874d7c-0e20-42a3-b5cd-8778072e05ac admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:41.927263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874d7c-0e20-42a3-b5cd-8778072e05ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:41.927650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874d7c-0e20-42a3-b5cd-8778072e05ac admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:41.928842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a874d7c-0e20-42a3-b5cd-8778072e05ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:41.932891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a874d7c-0e20-42a3-b5cd-8778072e05ac admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:41.971378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1090/2190] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:34:41 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:34:41.976684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26823f5c-cb9f-4385-92b3-e0a22bd0590e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:42.000435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26823f5c-cb9f-4385-92b3-e0a22bd0590e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:42.017444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60628-87f0-4c79-926a-92d1969b298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:42.019406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60628-87f0-4c79-926a-92d1969b298a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:42.019977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60628-87f0-4c79-926a-92d1969b298a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:42.020557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60628-87f0-4c79-926a-92d1969b298a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:42.022328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff60628-87f0-4c79-926a-92d1969b298a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:42.025204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff60628-87f0-4c79-926a-92d1969b298a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:42.052930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1101/2191] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:42.063274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a874d7c-0e20-42a3-b5cd-8778072e05ac admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:42.073793 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a874d7c-0e20-42a3-b5cd-8778072e05ac admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:42.079344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167d93b-d163-498e-b0c6-a99d14cde909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:42.079611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d93b-d163-498e-b0c6-a99d14cde909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:42.079894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d93b-d163-498e-b0c6-a99d14cde909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:42.080176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167d93b-d163-498e-b0c6-a99d14cde909 admin admin] PATH_INFO: `/v3/projects/c46ec8f500da47a5862f221f8aed6e6e/users/1c51189a3eff43c8a6eb7d6dabf00d08/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:42.098002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167d93b-d163-498e-b0c6-a99d14cde909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46ec8f500da47a5862f221f8aed6e6e, user_id=1c51189a3eff43c8a6eb7d6dabf00d08, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:42.100753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167d93b-d163-498e-b0c6-a99d14cde909 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:42.116397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1091/2192] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:42 2022] PUT /identity/v3/projects/c46ec8f500da47a5862f221f8aed6e6e/users/1c51189a3eff43c8a6eb7d6dabf00d08/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:42.121734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60628-87f0-4c79-926a-92d1969b298a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:42.133525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60628-87f0-4c79-926a-92d1969b298a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:42.205742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f321b05-73c3-4f23-bbe8-c49eda777926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:42.206387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321b05-73c3-4f23-bbe8-c49eda777926 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:42.206668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321b05-73c3-4f23-bbe8-c49eda777926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:42.206941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321b05-73c3-4f23-bbe8-c49eda777926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:42.207724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f321b05-73c3-4f23-bbe8-c49eda777926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:42.209797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f321b05-73c3-4f23-bbe8-c49eda777926 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:42.230962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1102/2193] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:42.236911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167d93b-d163-498e-b0c6-a99d14cde909 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:42.252595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167d93b-d163-498e-b0c6-a99d14cde909 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:42.266324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:42.266732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:42.266994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:42.269621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] PATH_INFO: `/v3/projects/c46ec8f500da47a5862f221f8aed6e6e/users/1c51189a3eff43c8a6eb7d6dabf00d08/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:42.274169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46ec8f500da47a5862f221f8aed6e6e, user_id=1c51189a3eff43c8a6eb7d6dabf00d08, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:42.280614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:42.305178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1092/2194] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:42 2022] PUT /identity/v3/projects/c46ec8f500da47a5862f221f8aed6e6e/users/1c51189a3eff43c8a6eb7d6dabf00d08/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:42.307591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a1d2-4072-4649-84b2-d1e11387bd92 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:42.307954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a1d2-4072-4649-84b2-d1e11387bd92 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:42.308477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a1d2-4072-4649-84b2-d1e11387bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:42.372473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bb09a1d2-4072-4649-84b2-d1e11387bd92 None None] MFA Rules not processed for user `1c51189a3eff43c8a6eb7d6dabf00d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:42.373739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bb09a1d2-4072-4649-84b2-d1e11387bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:42.493824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1103/2195] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:42.505010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:42.507572 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:42.520814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:42.593735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa37f0-991d-4ee9-9cc9-037d865a6036 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:42.598753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10789d5-31d4-4987-8c77-174d69c6c444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:42.599859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10789d5-31d4-4987-8c77-174d69c6c444 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:42.600337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10789d5-31d4-4987-8c77-174d69c6c444 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:42.600880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10789d5-31d4-4987-8c77-174d69c6c444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:42.673627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10789d5-31d4-4987-8c77-174d69c6c444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:42.675145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10789d5-31d4-4987-8c77-174d69c6c444 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:42.688286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1093/2196] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:44.433875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a1d2-4072-4649-84b2-d1e11387bd92 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:44.435830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bb09a1d2-4072-4649-84b2-d1e11387bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:44.471373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a1d2-4072-4649-84b2-d1e11387bd92 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:44.475981 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb20083-98d6-4da1-903e-947989be49ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:44.476751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb20083-98d6-4da1-903e-947989be49ec service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:44.477065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb20083-98d6-4da1-903e-947989be49ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:44.477611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb20083-98d6-4da1-903e-947989be49ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:44.608646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb20083-98d6-4da1-903e-947989be49ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:44.610251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb20083-98d6-4da1-903e-947989be49ec service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:44.627023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1104/2197] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:34:45.452534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10789d5-31d4-4987-8c77-174d69c6c444 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:45.468081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10789d5-31d4-4987-8c77-174d69c6c444 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:45.472576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:45.473181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:45.473463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:45.473741 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:45.489765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:45.491744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:45.504070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1094/2198] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:47.374683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486e07-0d5c-4b4b-a40f-658534aab247 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:47.375282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486e07-0d5c-4b4b-a40f-658534aab247 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:47.375282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486e07-0d5c-4b4b-a40f-658534aab247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:47.392933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:47.398513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ea486e07-0d5c-4b4b-a40f-658534aab247 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:47.399832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ea486e07-0d5c-4b4b-a40f-658534aab247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:47.515040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1105/2199] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:47.538118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:47.540958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:47.673731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af5342-5158-4ebe-ae37-2c47c8c738a1 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:47.682383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042e6ba-5873-469a-839c-76f149b0a6ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:47.683053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042e6ba-5873-469a-839c-76f149b0a6ea service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:47.683383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042e6ba-5873-469a-839c-76f149b0a6ea service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:47.683775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042e6ba-5873-469a-839c-76f149b0a6ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:47.703234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042e6ba-5873-469a-839c-76f149b0a6ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:47.705684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042e6ba-5873-469a-839c-76f149b0a6ea service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:47.716946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1095/2200] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:34:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:34:50.015212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486e07-0d5c-4b4b-a40f-658534aab247 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:50.136493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418721-79e0-4af0-bb81-deba332197f3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:50.137126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418721-79e0-4af0-bb81-deba332197f3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:50.137126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418721-79e0-4af0-bb81-deba332197f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:50.172351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-66418721-79e0-4af0-bb81-deba332197f3 None None] MFA Rules not processed for user `e6abe049ae6a4b5db081fcc0e164075b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:50.174052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-66418721-79e0-4af0-bb81-deba332197f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:50.207936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486e07-0d5c-4b4b-a40f-658534aab247 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:50.230836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:50.231117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:50.231608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:50.232157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:50.232831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] PATH_INFO: `/v3/users/53ad30175f2e458f8749251436600e69` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:50.236870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ad30175f2e458f8749251436600e69)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:50.238930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:50.303593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1096/2201] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:34:50.451983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ad30175f2e458f8749251436600e69'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:50.515731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ad30175f2e458f8749251436600e69'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:50.530917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ad30175f2e458f8749251436600e69'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:50.532157 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ad30175f2e458f8749251436600e69'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:50.533272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ad30175f2e458f8749251436600e69'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:50.560457 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1106/2202] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:34:50 2022] DELETE /identity/v3/users/53ad30175f2e458f8749251436600e69 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:50.561247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbfffe-72fe-4ca6-a410-afa9811aa97c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:50.561393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbfffe-72fe-4ca6-a410-afa9811aa97c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:50.562177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbfffe-72fe-4ca6-a410-afa9811aa97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:50.601979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-66bbfffe-72fe-4ca6-a410-afa9811aa97c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:50.607997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-66bbfffe-72fe-4ca6-a410-afa9811aa97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:50.809181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1097/2203] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:51.038935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:51.040618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:51.098127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:51.139511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0d03-34f1-4b1e-a7bc-d713684e105e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:51.149215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c8ef0-a8cd-4996-bdec-cca26bd74de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:51.150553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c8ef0-a8cd-4996-bdec-cca26bd74de5 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:51.151039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c8ef0-a8cd-4996-bdec-cca26bd74de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:51.151499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c8ef0-a8cd-4996-bdec-cca26bd74de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:51.163598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c8ef0-a8cd-4996-bdec-cca26bd74de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:51.166192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c8ef0-a8cd-4996-bdec-cca26bd74de5 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:51.194900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1107/2204] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:34:52.079347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbfffe-72fe-4ca6-a410-afa9811aa97c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:52.081665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-66bbfffe-72fe-4ca6-a410-afa9811aa97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:52.106657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbfffe-72fe-4ca6-a410-afa9811aa97c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:52.145663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:52.146327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:52.146662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:52.147059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] PATH_INFO: `/v3/projects/3969dcf93bf746118820907de777f3df` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:52.149441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3969dcf93bf746118820907de777f3df)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:52.152078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:52.239496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3969dcf93bf746118820907de777f3df', 'request_id': 'req-1c803a08-e88d-4c77-837c-fc663fce1e26'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.260827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3969dcf93bf746118820907de777f3df', 'request_id': 'req-1c803a08-e88d-4c77-837c-fc663fce1e26'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.280241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3969dcf93bf746118820907de777f3df', 'request_id': 'req-1c803a08-e88d-4c77-837c-fc663fce1e26'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.298235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] The token cache is being invalidate because project 3969dcf93bf746118820907de777f3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:34:52.299552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.300644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.306930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c8ef0-a8cd-4996-bdec-cca26bd74de5 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:52.313384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1098/2205] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:34:52 2022] DELETE /identity/v3/projects/3969dcf93bf746118820907de777f3df => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:52.321345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c8ef0-a8cd-4996-bdec-cca26bd74de5 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:52.434174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:52.434843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:52.435299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:52.435583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] PATH_INFO: `/v3/users/2c0d36e2c97a4fe4ad9dfcb19b8a9027` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:52.437088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0d36e2c97a4fe4ad9dfcb19b8a9027)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:52.439608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:52.605125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0d36e2c97a4fe4ad9dfcb19b8a9027'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.634115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0d36e2c97a4fe4ad9dfcb19b8a9027'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.665348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0d36e2c97a4fe4ad9dfcb19b8a9027'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.666293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0d36e2c97a4fe4ad9dfcb19b8a9027'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.682672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0d36e2c97a4fe4ad9dfcb19b8a9027'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:52.682952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1108/2206] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:34:52 2022] DELETE /identity/v3/users/2c0d36e2c97a4fe4ad9dfcb19b8a9027 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:53.166701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:53.169158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:53.206724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c803a08-e88d-4c77-837c-fc663fce1e26 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:53.364405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:53.365628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:53.367767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:53.368417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] PATH_INFO: `/v3/projects/05c2513e711d4eb1bb470f5301de46ff` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:53.373517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c2513e711d4eb1bb470f5301de46ff)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:53.378355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:53.409162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:53.506760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c2513e711d4eb1bb470f5301de46ff', 'request_id': 'req-66b8edc4-2168-4549-8cb0-c82019a44477'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.519078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c2513e711d4eb1bb470f5301de46ff', 'request_id': 'req-66b8edc4-2168-4549-8cb0-c82019a44477'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.534217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c2513e711d4eb1bb470f5301de46ff', 'request_id': 'req-66b8edc4-2168-4549-8cb0-c82019a44477'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.547628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] The token cache is being invalidate because project 05c2513e711d4eb1bb470f5301de46ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:34:53.548195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.549031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.550714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1099/2207] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:34:53 2022] DELETE /identity/v3/projects/05c2513e711d4eb1bb470f5301de46ff => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:53.556230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:53.558791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:53.588867 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d821c54-debe-482c-af57-4de95ba76709 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:53.681067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:53.699444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:53.701516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:53.701916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:53.702857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] PATH_INFO: `/v3/users/1c51189a3eff43c8a6eb7d6dabf00d08` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:53.704265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c51189a3eff43c8a6eb7d6dabf00d08)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:53.706533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:53.819501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c51189a3eff43c8a6eb7d6dabf00d08'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.841975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c51189a3eff43c8a6eb7d6dabf00d08'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.858187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c51189a3eff43c8a6eb7d6dabf00d08'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.858912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c51189a3eff43c8a6eb7d6dabf00d08'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.859659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef1fbc8d-1d25-4a32-add7-f3edb1fdad7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c51189a3eff43c8a6eb7d6dabf00d08'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:53.890994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1109/2208] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:34:53 2022] DELETE /identity/v3/users/1c51189a3eff43c8a6eb7d6dabf00d08 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:54.525370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:54.527406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:54.576250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8edc4-2168-4549-8cb0-c82019a44477 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:54.749169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:54.752171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:54.752171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:54.752754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] PATH_INFO: `/v3/projects/c46ec8f500da47a5862f221f8aed6e6e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:54.756727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46ec8f500da47a5862f221f8aed6e6e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:54.759627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:54.836047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46ec8f500da47a5862f221f8aed6e6e', 'request_id': 'req-e7f35c2a-b119-4421-b59b-bf2860e80e74'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:54.846568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46ec8f500da47a5862f221f8aed6e6e', 'request_id': 'req-e7f35c2a-b119-4421-b59b-bf2860e80e74'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:54.863014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46ec8f500da47a5862f221f8aed6e6e', 'request_id': 'req-e7f35c2a-b119-4421-b59b-bf2860e80e74'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:54.892313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] The token cache is being invalidate because project c46ec8f500da47a5862f221f8aed6e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:34:54.893686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:54.894968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7f35c2a-b119-4421-b59b-bf2860e80e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:34:54.900030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1100/2209] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:34:54 2022] DELETE /identity/v3/projects/c46ec8f500da47a5862f221f8aed6e6e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:54.902410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646be97-f971-4369-8de4-a86ce435d306 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:54.903284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646be97-f971-4369-8de4-a86ce435d306 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:54.903699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646be97-f971-4369-8de4-a86ce435d306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:54.928748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c646be97-f971-4369-8de4-a86ce435d306 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:54.930364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c646be97-f971-4369-8de4-a86ce435d306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:55.061338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1110/2210] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:55.137935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733c30f-2159-4757-aa15-06c7da0d52d8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:55.138251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733c30f-2159-4757-aa15-06c7da0d52d8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:55.138844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733c30f-2159-4757-aa15-06c7da0d52d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:55.170973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d733c30f-2159-4757-aa15-06c7da0d52d8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:55.172581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d733c30f-2159-4757-aa15-06c7da0d52d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:55.196784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1101/2211] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:55.197716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646be97-f971-4369-8de4-a86ce435d306 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:55.217784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646be97-f971-4369-8de4-a86ce435d306 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:55.252481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:55.252481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:55.252481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:55.252481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:55.253330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:34:55.253330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:55.257880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:55.301109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1111/2212] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:34:55.306245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733c30f-2159-4757-aa15-06c7da0d52d8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:55.319387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733c30f-2159-4757-aa15-06c7da0d52d8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:55.325141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ccdff-4020-4cf5-ad96-721946b6350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:55.326141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ccdff-4020-4cf5-ad96-721946b6350d admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:55.326754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ccdff-4020-4cf5-ad96-721946b6350d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:55.327041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ccdff-4020-4cf5-ad96-721946b6350d admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:55.331068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ccdff-4020-4cf5-ad96-721946b6350d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:55.331068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ccdff-4020-4cf5-ad96-721946b6350d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:55.363085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:55.379955 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1102/2213] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:34:55 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:55.380265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:55.393346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8249f2a-e1e9-4925-ae50-f67f68f3d99c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:55.489133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d9c71-5073-4169-9dfe-3974778542e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:55.489257 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9c71-5073-4169-9dfe-3974778542e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:55.489707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9c71-5073-4169-9dfe-3974778542e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:55.489990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9c71-5073-4169-9dfe-3974778542e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:55.491034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d9c71-5073-4169-9dfe-3974778542e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:55.493739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d9c71-5073-4169-9dfe-3974778542e7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:55.506137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:34:55.540130 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ccdff-4020-4cf5-ad96-721946b6350d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:55.547653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1112/2214] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:34:55 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:34:55.552577 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ccdff-4020-4cf5-ad96-721946b6350d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:55.557855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ad69e-c5af-4ef1-91d7-db65cd210b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:55.558870 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ad69e-c5af-4ef1-91d7-db65cd210b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:55.559456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ad69e-c5af-4ef1-91d7-db65cd210b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:55.559941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ad69e-c5af-4ef1-91d7-db65cd210b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:55.560891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ad69e-c5af-4ef1-91d7-db65cd210b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:55.562773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ad69e-c5af-4ef1-91d7-db65cd210b38 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:55.582733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1103/2215] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:34:55.584114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d9c71-5073-4169-9dfe-3974778542e7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:55.602996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d9c71-5073-4169-9dfe-3974778542e7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:55.609306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc74027-43fe-4c30-aa52-9493af1e23b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:55.610150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74027-43fe-4c30-aa52-9493af1e23b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:55.610535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74027-43fe-4c30-aa52-9493af1e23b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:55.610908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74027-43fe-4c30-aa52-9493af1e23b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:55.611754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc74027-43fe-4c30-aa52-9493af1e23b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:55.614883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc74027-43fe-4c30-aa52-9493af1e23b1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:55.634538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ad69e-c5af-4ef1-91d7-db65cd210b38 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:55.635397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1113/2216] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:34:55.652029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ad69e-c5af-4ef1-91d7-db65cd210b38 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:55.657751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:55.658481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:55.658769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:55.659054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] PATH_INFO: `/v3/projects/714823d654444a6c912ce123688b9a17/users/c9d1651758594bfe859d55f334fb9bc0/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:55.681410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714823d654444a6c912ce123688b9a17, user_id=c9d1651758594bfe859d55f334fb9bc0, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:55.684768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:55.716559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1104/2217] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:34:55 2022] PUT /identity/v3/projects/714823d654444a6c912ce123688b9a17/users/c9d1651758594bfe859d55f334fb9bc0/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:34:55.727558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c36e8-e3f4-4e39-a8d8-1748f109c915 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:55.727743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c36e8-e3f4-4e39-a8d8-1748f109c915 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:55.728244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c36e8-e3f4-4e39-a8d8-1748f109c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:55.766820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-799c36e8-e3f4-4e39-a8d8-1748f109c915 None None] MFA Rules not processed for user `c9d1651758594bfe859d55f334fb9bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:34:55.784355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-799c36e8-e3f4-4e39-a8d8-1748f109c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:55.936318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1114/2218] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:34:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:34:55.952661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:34:55.954487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:34:56.104009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4a1a2-f11e-4d3c-9a72-908269b60e23 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:34:56.115424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda7693-7de2-4c4f-aec7-c7a96df95ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:34:56.116538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7693-7de2-4c4f-aec7-c7a96df95ffc service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:34:56.116538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7693-7de2-4c4f-aec7-c7a96df95ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:34:56.116792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7693-7de2-4c4f-aec7-c7a96df95ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:34:56.141923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda7693-7de2-4c4f-aec7-c7a96df95ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:34:56.143565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda7693-7de2-4c4f-aec7-c7a96df95ffc service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:34:56.183232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1105/2219] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:34:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:35:03.735045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c36e8-e3f4-4e39-a8d8-1748f109c915 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:03.736593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-799c36e8-e3f4-4e39-a8d8-1748f109c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:03.839910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c36e8-e3f4-4e39-a8d8-1748f109c915 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:03.844796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:03.845535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:03.845671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:03.846097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:03.848735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:03.965905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:03.967521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:03.980284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1115/2220] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:35:04.519282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c03a32-9996-41cc-b74e-1e6b83e0752f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:04.521445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c03a32-9996-41cc-b74e-1e6b83e0752f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:04.521445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c03a32-9996-41cc-b74e-1e6b83e0752f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:04.550084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-61c03a32-9996-41cc-b74e-1e6b83e0752f None None] MFA Rules not processed for user `2b12b04d85d84994a29f1fe434bbd0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:04.551622 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-61c03a32-9996-41cc-b74e-1e6b83e0752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:04.715359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1106/2221] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:35:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:35:09.008027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:09.050418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:35:09.121908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b844f36-4e77-4bce-ba6f-79cb04985c35 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:09.128036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:09.128778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:09.129139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:09.129419 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] PATH_INFO: `/v3/users/c9d1651758594bfe859d55f334fb9bc0` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:09.130959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d1651758594bfe859d55f334fb9bc0)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:09.132978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:09.198111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d1651758594bfe859d55f334fb9bc0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:09.223608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d1651758594bfe859d55f334fb9bc0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:09.236640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d1651758594bfe859d55f334fb9bc0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:09.238516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d1651758594bfe859d55f334fb9bc0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:09.239214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d1651758594bfe859d55f334fb9bc0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:09.260173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1116/2222] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:35:09 2022] DELETE /identity/v3/users/c9d1651758594bfe859d55f334fb9bc0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:35:09.264892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3dd65-a7cd-407c-8814-7403f12852c9 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:09.265935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3dd65-a7cd-407c-8814-7403f12852c9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:09.265935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3dd65-a7cd-407c-8814-7403f12852c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:09.287576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ebf3dd65-a7cd-407c-8814-7403f12852c9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:09.289005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ebf3dd65-a7cd-407c-8814-7403f12852c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:09.361488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1107/2223] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:35:09.367468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:09.369196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:09.434184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df6809-cf1d-4727-89ee-bf1ae269bbab admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:09.437982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfffae3-539c-42ab-9d55-112b9c93c2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:09.438594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffae3-539c-42ab-9d55-112b9c93c2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:09.438873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffae3-539c-42ab-9d55-112b9c93c2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:09.439146 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffae3-539c-42ab-9d55-112b9c93c2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:09.448715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfffae3-539c-42ab-9d55-112b9c93c2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:09.450164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfffae3-539c-42ab-9d55-112b9c93c2d5 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:09.460304 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1117/2224] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:35:10.028375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3dd65-a7cd-407c-8814-7403f12852c9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:10.030303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ebf3dd65-a7cd-407c-8814-7403f12852c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:10.045325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3dd65-a7cd-407c-8814-7403f12852c9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:10.050413 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:10.051057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:10.051333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:10.051605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] PATH_INFO: `/v3/projects/714823d654444a6c912ce123688b9a17` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:10.052945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] RBAC: Authorizing `identity:delete_project(project_id=714823d654444a6c912ce123688b9a17)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:10.054899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:10.063306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:35:10.118173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714823d654444a6c912ce123688b9a17', 'request_id': 'req-e31307d1-ca83-434b-8971-60003331febf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:10.131591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714823d654444a6c912ce123688b9a17', 'request_id': 'req-e31307d1-ca83-434b-8971-60003331febf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:10.144606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714823d654444a6c912ce123688b9a17', 'request_id': 'req-e31307d1-ca83-434b-8971-60003331febf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:10.175019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] The token cache is being invalidate because project 714823d654444a6c912ce123688b9a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:35:10.190503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:10.197573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e31307d1-ca83-434b-8971-60003331febf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:10.201472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1108/2225] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:35:10 2022] DELETE /identity/v3/projects/714823d654444a6c912ce123688b9a17 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:35:12.192762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa55ac-43eb-426a-ba65-c84c6eaaded9 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.193267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa55ac-43eb-426a-ba65-c84c6eaaded9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.193267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa55ac-43eb-426a-ba65-c84c6eaaded9 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.195062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1118/2226] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:35:12.201077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be0dc-c3e6-45fb-9898-d663ff195039 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.201717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be0dc-c3e6-45fb-9898-d663ff195039 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.201717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be0dc-c3e6-45fb-9898-d663ff195039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.224873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-758be0dc-c3e6-45fb-9898-d663ff195039 None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:12.226135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-758be0dc-c3e6-45fb-9898-d663ff195039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:12.314868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1109/2227] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:35:12.328679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa55ac-43eb-426a-ba65-c84c6eaaded9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:12.330481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dafa55ac-43eb-426a-ba65-c84c6eaaded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:12.381772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:35:12.402050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa55ac-43eb-426a-ba65-c84c6eaaded9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:12.406571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc60f1d-b46f-4d55-8a06-684a5664e176 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7ccabe29f4464bafbdd7b5aab7d775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:12.407200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc60f1d-b46f-4d55-8a06-684a5664e176 service glance] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.407476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc60f1d-b46f-4d55-8a06-684a5664e176 service glance] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.407752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc60f1d-b46f-4d55-8a06-684a5664e176 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.418639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc60f1d-b46f-4d55-8a06-684a5664e176 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:12.420098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc60f1d-b46f-4d55-8a06-684a5664e176 service glance] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:12.431876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1119/2228] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:35:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:35:12.521938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb805d-4bb9-47a0-a955-45d65abe4622 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.522277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb805d-4bb9-47a0-a955-45d65abe4622 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.522565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb805d-4bb9-47a0-a955-45d65abe4622 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.523980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1110/2229] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:35:12.529352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda96ff0-ea39-493c-ae48-213dd9476241 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.529637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda96ff0-ea39-493c-ae48-213dd9476241 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.529911 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda96ff0-ea39-493c-ae48-213dd9476241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.551265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bda96ff0-ea39-493c-ae48-213dd9476241 None None] MFA Rules not processed for user `b310f17f81e040ac80dc1b9de52026f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:12.552901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bda96ff0-ea39-493c-ae48-213dd9476241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:12.611847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1120/2230] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:35:12.624459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb805d-4bb9-47a0-a955-45d65abe4622 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:12.626131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5efb805d-4bb9-47a0-a955-45d65abe4622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:12.641472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb805d-4bb9-47a0-a955-45d65abe4622 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:12.645582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb2120-ca0e-4f1a-92a7-972199f78779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:12.646191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2120-ca0e-4f1a-92a7-972199f78779 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.646490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2120-ca0e-4f1a-92a7-972199f78779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.646760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2120-ca0e-4f1a-92a7-972199f78779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.654471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb2120-ca0e-4f1a-92a7-972199f78779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:12.656071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb2120-ca0e-4f1a-92a7-972199f78779 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:12.664002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1111/2231] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:35:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:35:12.804723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58af034-b09f-4e1d-9ab3-0cf0913a1667 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.805088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58af034-b09f-4e1d-9ab3-0cf0913a1667 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.805393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58af034-b09f-4e1d-9ab3-0cf0913a1667 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.806916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1121/2232] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:35:12.813746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54fbeb-320b-4382-a25f-3920758d7048 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.814053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54fbeb-320b-4382-a25f-3920758d7048 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.814335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54fbeb-320b-4382-a25f-3920758d7048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.836506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1d54fbeb-320b-4382-a25f-3920758d7048 None None] MFA Rules not processed for user `536e042f0d76408b9379af15526878b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:12.837757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1d54fbeb-320b-4382-a25f-3920758d7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:12.848993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1112/2233] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:35:12.861073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58af034-b09f-4e1d-9ab3-0cf0913a1667 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:12.863398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c58af034-b09f-4e1d-9ab3-0cf0913a1667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:12.895890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58af034-b09f-4e1d-9ab3-0cf0913a1667 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:12.900791 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da60b0-0799-46cf-81f8-0bd4c3472446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:12.901671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da60b0-0799-46cf-81f8-0bd4c3472446 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:12.902113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da60b0-0799-46cf-81f8-0bd4c3472446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:12.902461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da60b0-0799-46cf-81f8-0bd4c3472446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:12.917700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da60b0-0799-46cf-81f8-0bd4c3472446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:12.918937 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da60b0-0799-46cf-81f8-0bd4c3472446 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:12.930792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1122/2234] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:35:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:35:17.626381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54fbeb-320b-4382-a25f-3920758d7048 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:17.627996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1d54fbeb-320b-4382-a25f-3920758d7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:17.732037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54fbeb-320b-4382-a25f-3920758d7048 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:17.739608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:17.740349 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:17.740669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:17.740977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:17.744508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:17.758825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:35:17.762460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:17.764565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:17.784038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1113/2235] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:35:21.775999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd816d-0ad1-4f1c-befd-873fb00ac0b9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:21.776747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd816d-0ad1-4f1c-befd-873fb00ac0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:21.777098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd816d-0ad1-4f1c-befd-873fb00ac0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:21.805319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5bbd816d-0ad1-4f1c-befd-873fb00ac0b9 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:21.806963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5bbd816d-0ad1-4f1c-befd-873fb00ac0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:21.880561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1123/2236] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:35:21.904926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:21.906715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:21.999187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb36c-ee24-43bd-834b-8def1850b9a1 service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:22.005726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28468c9-1f91-40b9-ba8d-f2729df2a231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:22.006370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28468c9-1f91-40b9-ba8d-f2729df2a231 service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:22.006651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28468c9-1f91-40b9-ba8d-f2729df2a231 service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:22.006931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28468c9-1f91-40b9-ba8d-f2729df2a231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:22.017657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28468c9-1f91-40b9-ba8d-f2729df2a231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:22.019297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28468c9-1f91-40b9-ba8d-f2729df2a231 service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:22.036591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1114/2237] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:35:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:35:31.871336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=62 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:35:32.024966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=34 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:35:40.951946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c70f8-5a9d-4a01-a6fb-fab54ac5a237 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:40.953477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c70f8-5a9d-4a01-a6fb-fab54ac5a237 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:40.953964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c70f8-5a9d-4a01-a6fb-fab54ac5a237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:40.983966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bd6c70f8-5a9d-4a01-a6fb-fab54ac5a237 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:40.985273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bd6c70f8-5a9d-4a01-a6fb-fab54ac5a237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:40.994010 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1124/2238] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:35:41.008483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28468c9-1f91-40b9-ba8d-f2729df2a231 service swift] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:41.020422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28468c9-1f91-40b9-ba8d-f2729df2a231 service swift] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:41.025956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ef6c-34a5-4804-8404-2bd424aa5c08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:41.026470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ef6c-34a5-4804-8404-2bd424aa5c08 service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:41.026747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ef6c-34a5-4804-8404-2bd424aa5c08 service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:41.027131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ef6c-34a5-4804-8404-2bd424aa5c08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:41.031189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1817075-9ef2-4027-8359-64885bbf9fc8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:41.031446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1817075-9ef2-4027-8359-64885bbf9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:41.031773 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1817075-9ef2-4027-8359-64885bbf9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:41.040507 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ef6c-34a5-4804-8404-2bd424aa5c08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:41.042663 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ef6c-34a5-4804-8404-2bd424aa5c08 service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:41.054284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b1817075-9ef2-4027-8359-64885bbf9fc8 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:41.055858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b1817075-9ef2-4027-8359-64885bbf9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:41.061080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1115/2239] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:35:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:35:41.064703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1125/2240] 10.222.0.55 () {58 vars in 967 bytes} [Tue Sep 13 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:35:41.082725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ef6c-34a5-4804-8404-2bd424aa5c08 service swift] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:41.094167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ef6c-34a5-4804-8404-2bd424aa5c08 service swift] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:41.101729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ccbb-05a4-426f-84e4-9bc2175711b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:41.102851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ccbb-05a4-426f-84e4-9bc2175711b5 service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:41.103425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ccbb-05a4-426f-84e4-9bc2175711b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:41.103904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ccbb-05a4-426f-84e4-9bc2175711b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:41.117372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ccbb-05a4-426f-84e4-9bc2175711b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:41.119702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ccbb-05a4-426f-84e4-9bc2175711b5 service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:41.133061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1116/2241] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:35:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:35:51.047119 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=6 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:35:51.126853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=12 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:35:57.462759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361543-b1bf-468d-a201-372f4d547061 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:57.463348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361543-b1bf-468d-a201-372f4d547061 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:57.463348 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361543-b1bf-468d-a201-372f4d547061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:57.490494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-de361543-b1bf-468d-a201-372f4d547061 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:35:57.491715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-de361543-b1bf-468d-a201-372f4d547061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:57.499751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1126/2242] 10.222.0.55 () {58 vars in 967 bytes} [Tue Sep 13 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:35:57.516218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ccbb-05a4-426f-84e4-9bc2175711b5 service swift] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:57.527648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ccbb-05a4-426f-84e4-9bc2175711b5 service swift] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:57.533394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d020a-9587-4730-bf14-9e0659b74fac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:57.533995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d020a-9587-4730-bf14-9e0659b74fac service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:57.534276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d020a-9587-4730-bf14-9e0659b74fac service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:57.534527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d020a-9587-4730-bf14-9e0659b74fac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:57.543108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d020a-9587-4730-bf14-9e0659b74fac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:57.544721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d020a-9587-4730-bf14-9e0659b74fac service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:57.554643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1117/2243] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:35:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:35:59.581283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de361543-b1bf-468d-a201-372f4d547061 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:59.586351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-de361543-b1bf-468d-a201-372f4d547061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:35:59.659164 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de361543-b1bf-468d-a201-372f4d547061 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:35:59.664234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:35:59.664949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:35:59.665228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:35:59.665501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] PATH_INFO: `/v3/users/2b12b04d85d84994a29f1fe434bbd0dc` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:35:59.666681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b12b04d85d84994a29f1fe434bbd0dc)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:35:59.668655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:35:59.730657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b12b04d85d84994a29f1fe434bbd0dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:59.743111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b12b04d85d84994a29f1fe434bbd0dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:59.752169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b12b04d85d84994a29f1fe434bbd0dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:59.752849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b12b04d85d84994a29f1fe434bbd0dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:59.753543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-372772dc-b0ea-4eb8-b5d2-6400ccec93d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b12b04d85d84994a29f1fe434bbd0dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:35:59.767334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1127/2244] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:35:59 2022] DELETE /identity/v3/users/2b12b04d85d84994a29f1fe434bbd0dc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:35:59.986043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d020a-9587-4730-bf14-9e0659b74fac service swift] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:35:59.998345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d020a-9587-4730-bf14-9e0659b74fac service swift] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:36:00.068249 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:36:00.068918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:36:00.069197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:36:00.069609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] PATH_INFO: `/v3/projects/161ef8b6cc294544869ff92d65c7180f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:36:00.071476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=161ef8b6cc294544869ff92d65c7180f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:36:00.073369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:36:00.126038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161ef8b6cc294544869ff92d65c7180f', 'request_id': 'req-f6d929b4-b666-471a-ae93-2c6a03885cbd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:36:00.133804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161ef8b6cc294544869ff92d65c7180f', 'request_id': 'req-f6d929b4-b666-471a-ae93-2c6a03885cbd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:36:00.141805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161ef8b6cc294544869ff92d65c7180f', 'request_id': 'req-f6d929b4-b666-471a-ae93-2c6a03885cbd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:36:00.154269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] The token cache is being invalidate because project 161ef8b6cc294544869ff92d65c7180f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:36:00.154579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:36:00.155293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6d929b4-b666-471a-ae93-2c6a03885cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:36:00.157195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1118/2245] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:35:59 2022] DELETE /identity/v3/projects/161ef8b6cc294544869ff92d65c7180f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:36:09.764974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:36:10.150770 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:36:15.436063 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c2d2-1722-4bde-a03c-f97d7bc1eb0a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:36:15.436671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c2d2-1722-4bde-a03c-f97d7bc1eb0a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:36:15.436671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c2d2-1722-4bde-a03c-f97d7bc1eb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:36:15.459315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9860c2d2-1722-4bde-a03c-f97d7bc1eb0a None None] MFA Rules not processed for user `2c871cad6d394173b2b43fc89940f1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:36:15.460876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9860c2d2-1722-4bde-a03c-f97d7bc1eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:36:15.520418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1128/2246] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:36:25.512416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=25 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:36:34.925064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8401c-1a99-45b2-b91a-92ded1ceb6ec None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:36:34.925654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8401c-1a99-45b2-b91a-92ded1ceb6ec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:36:34.925654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8401c-1a99-45b2-b91a-92ded1ceb6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:36:34.946618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f2d8401c-1a99-45b2-b91a-92ded1ceb6ec None None] MFA Rules not processed for user `e6abe049ae6a4b5db081fcc0e164075b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:36:34.947846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f2d8401c-1a99-45b2-b91a-92ded1ceb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:36:35.011006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1119/2247] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:36:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:36:37.269891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cac169-ddfe-4eae-b0ab-c7b7eed4aa6e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:36:37.270415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cac169-ddfe-4eae-b0ab-c7b7eed4aa6e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:36:37.271086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cac169-ddfe-4eae-b0ab-c7b7eed4aa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:36:37.302582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c8cac169-ddfe-4eae-b0ab-c7b7eed4aa6e None None] MFA Rules not processed for user `452b906a5338428d8fc824ddff2093e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:36:37.304877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c8cac169-ddfe-4eae-b0ab-c7b7eed4aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:36:37.378339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1129/2248] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:36:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:36:45.004217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=25 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:36:47.369725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=25 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:06.561814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a479e5-61f8-4312-a97d-665fbb77d83e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:06.562360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a479e5-61f8-4312-a97d-665fbb77d83e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:06.562360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a479e5-61f8-4312-a97d-665fbb77d83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:06.585812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-30a479e5-61f8-4312-a97d-665fbb77d83e None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:06.587641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-30a479e5-61f8-4312-a97d-665fbb77d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:06.651650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1120/2249] 10.222.0.55 () {58 vars in 967 bytes} [Tue Sep 13 12:37:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:37:06.714912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cac169-ddfe-4eae-b0ab-c7b7eed4aa6e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:06.716769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c8cac169-ddfe-4eae-b0ab-c7b7eed4aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:06.791344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cac169-ddfe-4eae-b0ab-c7b7eed4aa6e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:06.796634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d30a69-5d69-4649-a43e-4baf5a07e169 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:06.797252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30a69-5d69-4649-a43e-4baf5a07e169 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:06.797519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30a69-5d69-4649-a43e-4baf5a07e169 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:06.797800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30a69-5d69-4649-a43e-4baf5a07e169 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:06.807125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d30a69-5d69-4649-a43e-4baf5a07e169 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:06.808747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d30a69-5d69-4649-a43e-4baf5a07e169 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:06.817287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1130/2250] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:37:13.792618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a479e5-61f8-4312-a97d-665fbb77d83e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:13.794257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-30a479e5-61f8-4312-a97d-665fbb77d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:13.872822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a479e5-61f8-4312-a97d-665fbb77d83e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:13.877575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:13.878264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:13.878537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:13.878808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] PATH_INFO: `/v3/users/151a9b6135264c0fa0f272a9115bf9c9` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:13.880015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151a9b6135264c0fa0f272a9115bf9c9)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:13.882000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:13.936722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151a9b6135264c0fa0f272a9115bf9c9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:13.946884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151a9b6135264c0fa0f272a9115bf9c9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:13.947860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151a9b6135264c0fa0f272a9115bf9c9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:13.948605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151a9b6135264c0fa0f272a9115bf9c9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:13.956000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151a9b6135264c0fa0f272a9115bf9c9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:13.974060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1121/2251] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:37:13 2022] DELETE /identity/v3/users/151a9b6135264c0fa0f272a9115bf9c9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:37:14.177931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d30a69-5d69-4649-a43e-4baf5a07e169 service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:14.189694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d30a69-5d69-4649-a43e-4baf5a07e169 service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:14.247984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:14.248663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:14.248949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:14.249224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] PATH_INFO: `/v3/projects/8a693ab56ef4401f8bf7dae678eeb6f3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:14.250358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a693ab56ef4401f8bf7dae678eeb6f3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:14.252323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:14.303934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a693ab56ef4401f8bf7dae678eeb6f3', 'request_id': 'req-61697312-0986-47f3-9932-432eb877c727'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.312696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a693ab56ef4401f8bf7dae678eeb6f3', 'request_id': 'req-61697312-0986-47f3-9932-432eb877c727'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.318393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a693ab56ef4401f8bf7dae678eeb6f3', 'request_id': 'req-61697312-0986-47f3-9932-432eb877c727'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.329455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] The token cache is being invalidate because project 8a693ab56ef4401f8bf7dae678eeb6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:37:14.329739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.330363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.331898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1131/2252] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:37:14 2022] DELETE /identity/v3/projects/8a693ab56ef4401f8bf7dae678eeb6f3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:37:14.336338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:14.337771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:14.351993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee3407-4be7-4c94-8f4c-507bbedd2299 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:14.380030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:14.421547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:14.422102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:14.422381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:14.422649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] PATH_INFO: `/v3/users/060c005229fb427f8b10b985c91a7e7a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:14.423778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=060c005229fb427f8b10b985c91a7e7a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:14.425830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:14.482996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060c005229fb427f8b10b985c91a7e7a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.494755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060c005229fb427f8b10b985c91a7e7a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.495457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060c005229fb427f8b10b985c91a7e7a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.496406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060c005229fb427f8b10b985c91a7e7a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.504954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f999ad91-a3e5-4127-aada-bba74a01c10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060c005229fb427f8b10b985c91a7e7a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.524827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1122/2253] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:37:14 2022] DELETE /identity/v3/users/060c005229fb427f8b10b985c91a7e7a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:37:14.727301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:14.729939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:14.744760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61697312-0986-47f3-9932-432eb877c727 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:14.767384 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:14.817702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:14.819136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:14.819488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:14.819856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] PATH_INFO: `/v3/projects/a544f7fd638a4661b5804f19ee282d5b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:14.821127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a544f7fd638a4661b5804f19ee282d5b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:14.823160 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:14.881305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a544f7fd638a4661b5804f19ee282d5b', 'request_id': 'req-7b6db3eb-9398-4ec7-b504-a33c73f958dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.890021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a544f7fd638a4661b5804f19ee282d5b', 'request_id': 'req-7b6db3eb-9398-4ec7-b504-a33c73f958dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.896062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a544f7fd638a4661b5804f19ee282d5b', 'request_id': 'req-7b6db3eb-9398-4ec7-b504-a33c73f958dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.908458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] The token cache is being invalidate because project a544f7fd638a4661b5804f19ee282d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:37:14.908677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.909365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b6db3eb-9398-4ec7-b504-a33c73f958dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:14.911067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1132/2254] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:37:14 2022] DELETE /identity/v3/projects/a544f7fd638a4661b5804f19ee282d5b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:37:14.917213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21412fd-7879-40f7-b045-8e2b9ea2d851 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:14.917753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21412fd-7879-40f7-b045-8e2b9ea2d851 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:14.917964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21412fd-7879-40f7-b045-8e2b9ea2d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:14.940148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f21412fd-7879-40f7-b045-8e2b9ea2d851 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:14.941400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f21412fd-7879-40f7-b045-8e2b9ea2d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:15.007013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1123/2255] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:37:15.015451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45df3a-7bcc-4390-886e-38224cd249e1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.015737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45df3a-7bcc-4390-886e-38224cd249e1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.016010 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45df3a-7bcc-4390-886e-38224cd249e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.037966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-af45df3a-7bcc-4390-886e-38224cd249e1 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:15.039633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-af45df3a-7bcc-4390-886e-38224cd249e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:15.048217 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1133/2256] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:15.052641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21412fd-7879-40f7-b045-8e2b9ea2d851 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:15.062454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21412fd-7879-40f7-b045-8e2b9ea2d851 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:15.066964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:15.067605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.067876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.068146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.068832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:37:15.069137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:15.070748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:15.082635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1124/2257] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:37:15.087235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45df3a-7bcc-4390-886e-38224cd249e1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:15.096910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45df3a-7bcc-4390-886e-38224cd249e1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:15.101999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b67df6-a7f6-48c2-b60b-c33fa2725369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:15.102613 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67df6-a7f6-48c2-b60b-c33fa2725369 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.102892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67df6-a7f6-48c2-b60b-c33fa2725369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.103165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67df6-a7f6-48c2-b60b-c33fa2725369 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.103802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b67df6-a7f6-48c2-b60b-c33fa2725369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:15.106133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b67df6-a7f6-48c2-b60b-c33fa2725369 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:15.138083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1134/2258] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:37:15 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:37:15.143022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:15.153545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb43d2e-c60d-444b-b2f0-30dcf73fb167 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:15.183939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:15.220307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13023e43-c192-4b40-92e1-c467884411c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:15.220868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023e43-c192-4b40-92e1-c467884411c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.221171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023e43-c192-4b40-92e1-c467884411c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.221439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023e43-c192-4b40-92e1-c467884411c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.222120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13023e43-c192-4b40-92e1-c467884411c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:15.224335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13023e43-c192-4b40-92e1-c467884411c3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:15.247503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1125/2259] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:37:15 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:37:15.252055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b67df6-a7f6-48c2-b60b-c33fa2725369 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:15.263306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b67df6-a7f6-48c2-b60b-c33fa2725369 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:15.268478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f729de-a794-4980-81f5-7d262d49e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:15.269124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f729de-a794-4980-81f5-7d262d49e58b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.269404 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f729de-a794-4980-81f5-7d262d49e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.269719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f729de-a794-4980-81f5-7d262d49e58b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.270451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f729de-a794-4980-81f5-7d262d49e58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:15.272085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f729de-a794-4980-81f5-7d262d49e58b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:15.283857 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1135/2260] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:37:15.288827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13023e43-c192-4b40-92e1-c467884411c3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:15.299530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13023e43-c192-4b40-92e1-c467884411c3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:15.306927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea42522-6ffa-411e-9d43-a94ce0b1e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:15.307588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea42522-6ffa-411e-9d43-a94ce0b1e9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.307902 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea42522-6ffa-411e-9d43-a94ce0b1e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.308097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea42522-6ffa-411e-9d43-a94ce0b1e9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.308841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea42522-6ffa-411e-9d43-a94ce0b1e9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:15.310746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea42522-6ffa-411e-9d43-a94ce0b1e9ea admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:15.322763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1126/2261] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:37:15.326996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f729de-a794-4980-81f5-7d262d49e58b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:15.337770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f729de-a794-4980-81f5-7d262d49e58b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:15.343226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:15.343926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.344351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.344643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] PATH_INFO: `/v3/projects/bbb89bbb7c554f7e8d599032a90839d9/users/02fa18f019ae4abf99a256638acd9ec3/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.362380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb89bbb7c554f7e8d599032a90839d9, user_id=02fa18f019ae4abf99a256638acd9ec3, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:15.365328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:15.381885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1136/2262] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:37:15 2022] PUT /identity/v3/projects/bbb89bbb7c554f7e8d599032a90839d9/users/02fa18f019ae4abf99a256638acd9ec3/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:37:15.388048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f003d-fc27-495e-805a-e31797609144 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.388536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f003d-fc27-495e-805a-e31797609144 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.388832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f003d-fc27-495e-805a-e31797609144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.410316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d80f003d-fc27-495e-805a-e31797609144 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:15.411737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d80f003d-fc27-495e-805a-e31797609144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:15.472984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1127/2263] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:15.483012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:15.485060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:15.541865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:15.548132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2e9a3-0f82-422f-9730-47a04c95a518 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:15.553207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5f7c2-d767-455a-ac06-1b34f1a30750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:15.553820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f7c2-d767-455a-ac06-1b34f1a30750 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:15.554264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f7c2-d767-455a-ac06-1b34f1a30750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:15.554536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f7c2-d767-455a-ac06-1b34f1a30750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:15.568040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5f7c2-d767-455a-ac06-1b34f1a30750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:15.569342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5f7c2-d767-455a-ac06-1b34f1a30750 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:15.580370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1137/2264] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:17.593956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f003d-fc27-495e-805a-e31797609144 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:17.596012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d80f003d-fc27-495e-805a-e31797609144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:17.665203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f003d-fc27-495e-805a-e31797609144 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:17.669934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:17.670716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:17.671097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:17.671465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:17.673658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:17.748779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:17.765751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:17.767232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:17.780720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1128/2265] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:20.148544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cb6b-de9b-4f38-aa76-df967249fe64 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:20.149155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cb6b-de9b-4f38-aa76-df967249fe64 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:20.149350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0cb6b-de9b-4f38-aa76-df967249fe64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:20.182585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-01a0cb6b-de9b-4f38-aa76-df967249fe64 None None] MFA Rules not processed for user `02fa18f019ae4abf99a256638acd9ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:20.183469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-01a0cb6b-de9b-4f38-aa76-df967249fe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:20.256558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1138/2266] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:20.261146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:20.277749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fb7d8-060a-4bbd-9f90-6109c4fe2d7f service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:20.282962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8a165-fa57-4977-9e85-ef02a72b2329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:20.283915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8a165-fa57-4977-9e85-ef02a72b2329 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:20.284167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8a165-fa57-4977-9e85-ef02a72b2329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:20.284495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8a165-fa57-4977-9e85-ef02a72b2329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:20.285248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8a165-fa57-4977-9e85-ef02a72b2329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:20.287599 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8a165-fa57-4977-9e85-ef02a72b2329 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:20.337344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1129/2267] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:37:20 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:37:20.342743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0cb6b-de9b-4f38-aa76-df967249fe64 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:20.355401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0cb6b-de9b-4f38-aa76-df967249fe64 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:20.430680 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64549a57-2bb0-4478-b041-c5a79f5cfcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:20.431311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64549a57-2bb0-4478-b041-c5a79f5cfcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:20.431587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64549a57-2bb0-4478-b041-c5a79f5cfcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:20.431862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64549a57-2bb0-4478-b041-c5a79f5cfcc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:20.432583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64549a57-2bb0-4478-b041-c5a79f5cfcc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:20.434540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64549a57-2bb0-4478-b041-c5a79f5cfcc2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:20.484147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1139/2268] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:37:20 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:37:20.489310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8a165-fa57-4977-9e85-ef02a72b2329 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:20.508309 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8a165-fa57-4977-9e85-ef02a72b2329 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:20.516746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43672388-1f74-49be-b735-32b83ca27821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:20.517791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43672388-1f74-49be-b735-32b83ca27821 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:20.518302 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43672388-1f74-49be-b735-32b83ca27821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:20.518799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43672388-1f74-49be-b735-32b83ca27821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:20.519980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43672388-1f74-49be-b735-32b83ca27821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:20.523152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43672388-1f74-49be-b735-32b83ca27821 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:20.543087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1130/2269] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:37:20.549559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64549a57-2bb0-4478-b041-c5a79f5cfcc2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:20.561445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64549a57-2bb0-4478-b041-c5a79f5cfcc2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:20.568559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486f3ab-38cc-4270-a0c5-a5c27f437fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:20.569713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486f3ab-38cc-4270-a0c5-a5c27f437fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:20.570276 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486f3ab-38cc-4270-a0c5-a5c27f437fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:20.570695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486f3ab-38cc-4270-a0c5-a5c27f437fc9 admin admin] PATH_INFO: `/v3/projects/f9213d19c218463287c9bb4324d60372/users/6f572d2ec93c4e758d559b839afe603e/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:20.605253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486f3ab-38cc-4270-a0c5-a5c27f437fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9213d19c218463287c9bb4324d60372, user_id=6f572d2ec93c4e758d559b839afe603e, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:20.608127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486f3ab-38cc-4270-a0c5-a5c27f437fc9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:20.632864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1140/2270] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:37:20 2022] PUT /identity/v3/projects/f9213d19c218463287c9bb4324d60372/users/6f572d2ec93c4e758d559b839afe603e/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:37:20.636895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43672388-1f74-49be-b735-32b83ca27821 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:20.648962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43672388-1f74-49be-b735-32b83ca27821 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:20.722751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b8a1-0a77-4c23-9de2-fa90a1551fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:20.723446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b8a1-0a77-4c23-9de2-fa90a1551fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:20.723732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b8a1-0a77-4c23-9de2-fa90a1551fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:20.724205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737b8a1-0a77-4c23-9de2-fa90a1551fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:20.725605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737b8a1-0a77-4c23-9de2-fa90a1551fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:20.727257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737b8a1-0a77-4c23-9de2-fa90a1551fa1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:20.739294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486f3ab-38cc-4270-a0c5-a5c27f437fc9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:20.743596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1131/2271] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:37:20.745066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b8a1-0a77-4c23-9de2-fa90a1551fa1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:20.760739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737b8a1-0a77-4c23-9de2-fa90a1551fa1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:20.766282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4debe6-0a07-4985-8db8-ce40cc3e8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:20.767133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4debe6-0a07-4985-8db8-ce40cc3e8435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:20.767422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4debe6-0a07-4985-8db8-ce40cc3e8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:20.767936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4debe6-0a07-4985-8db8-ce40cc3e8435 admin admin] PATH_INFO: `/v3/projects/f9213d19c218463287c9bb4324d60372/users/6f572d2ec93c4e758d559b839afe603e/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:20.770109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4debe6-0a07-4985-8db8-ce40cc3e8435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9213d19c218463287c9bb4324d60372, user_id=6f572d2ec93c4e758d559b839afe603e, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:20.773521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4debe6-0a07-4985-8db8-ce40cc3e8435 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:20.796427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1132/2272] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:37:20 2022] PUT /identity/v3/projects/f9213d19c218463287c9bb4324d60372/users/6f572d2ec93c4e758d559b839afe603e/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:37:20.804776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:20.822001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486f3ab-38cc-4270-a0c5-a5c27f437fc9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:20.899598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:20.900473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:20.900758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:20.901032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:20.903498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:21.030536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:21.032621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:21.046165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1141/2273] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:37:27.410333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f3b1c-407f-4513-9a68-4369ab7cc013 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:27.410867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f3b1c-407f-4513-9a68-4369ab7cc013 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:27.411152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f3b1c-407f-4513-9a68-4369ab7cc013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:27.469878 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f86f3b1c-407f-4513-9a68-4369ab7cc013 None None] MFA Rules not processed for user `6f572d2ec93c4e758d559b839afe603e`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:27.471483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f86f3b1c-407f-4513-9a68-4369ab7cc013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:27.563975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1133/2274] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:27.578630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:27.580172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:27.598812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad236bc-9fe0-4e26-9eed-691b7358585d service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:27.607770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2e8c-827d-4050-afb8-0c66e7963171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:27.608527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2e8c-827d-4050-afb8-0c66e7963171 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:27.609062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2e8c-827d-4050-afb8-0c66e7963171 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:27.610430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2e8c-827d-4050-afb8-0c66e7963171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:27.683589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af2e8c-827d-4050-afb8-0c66e7963171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:27.685540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af2e8c-827d-4050-afb8-0c66e7963171 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:27.696445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1142/2275] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:37:29.174260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1e19-9487-4b1a-a4fe-c0fedc0b17d7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:29.174757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1e19-9487-4b1a-a4fe-c0fedc0b17d7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:29.174852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1e19-9487-4b1a-a4fe-c0fedc0b17d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:29.211573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e01a1e19-9487-4b1a-a4fe-c0fedc0b17d7 None None] MFA Rules not processed for user `02fa18f019ae4abf99a256638acd9ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:29.213421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e01a1e19-9487-4b1a-a4fe-c0fedc0b17d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:29.225614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1134/2276] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:33.421482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09012-e8a9-4635-9935-4d6b48a84a53 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:33.422077 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09012-e8a9-4635-9935-4d6b48a84a53 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:33.422077 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09012-e8a9-4635-9935-4d6b48a84a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:33.483852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e5d09012-e8a9-4635-9935-4d6b48a84a53 None None] MFA Rules not processed for user `2c871cad6d394173b2b43fc89940f1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:33.497339 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e5d09012-e8a9-4635-9935-4d6b48a84a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:33.645117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:33.695585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1143/2277] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:34.123554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a1e19-9487-4b1a-a4fe-c0fedc0b17d7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:34.136792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a1e19-9487-4b1a-a4fe-c0fedc0b17d7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:34.148516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:34.149723 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:34.150024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:34.150354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:34.152620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:34.164600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:34.166082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:34.175830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1135/2278] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:36.796902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037457-4308-4f36-b320-6c9fbb7f61c0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:36.797389 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037457-4308-4f36-b320-6c9fbb7f61c0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:36.797482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037457-4308-4f36-b320-6c9fbb7f61c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:36.826138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4d037457-4308-4f36-b320-6c9fbb7f61c0 None None] MFA Rules not processed for user `686c11bf06de4a0480b637d70ddc0ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:36.828167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4d037457-4308-4f36-b320-6c9fbb7f61c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:36.960996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1144/2279] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:37.808872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:37.827479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1228-f0b6-4988-adc4-ebfd8c3442dd service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:37.835650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:37.836571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:37.837016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:37.837440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:37.840839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:37.853172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d037457-4308-4f36-b320-6c9fbb7f61c0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:37.855544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:37.856637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4d037457-4308-4f36-b320-6c9fbb7f61c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:37.933359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:37.935221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:37.942538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d037457-4308-4f36-b320-6c9fbb7f61c0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:37.948466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:37.949253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:37.949536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:37.949811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:37.951306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1136/2280] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:37.952252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:37.965934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:37.967696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:37.979575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1145/2281] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:37:45.501222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:45.502823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:45.518967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d1e5a-2218-4a68-90c4-b9721d2da26f service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:45.525411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:45.526066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:45.526356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:45.526609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:45.528584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:45.541794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:45.543993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:45.558429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1137/2282] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:45.719479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:45.733544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25b879-0108-45e6-9762-1668af7b5338 service placement] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:45.739876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:45.740573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:45.740866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:45.741134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:45.742977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:45.802349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:45.803855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:45.813192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1146/2283] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:50.939069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:50.953257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f1e9-71f8-430b-88c7-ae6b9358c4ad service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:50.963451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee165ac5-ba33-4148-ba0a-2c80c5274362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:50.964995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165ac5-ba33-4148-ba0a-2c80c5274362 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:50.965718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165ac5-ba33-4148-ba0a-2c80c5274362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:50.966426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165ac5-ba33-4148-ba0a-2c80c5274362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:50.970569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ee165ac5-ba33-4148-ba0a-2c80c5274362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:51.094685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee165ac5-ba33-4148-ba0a-2c80c5274362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:51.102216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee165ac5-ba33-4148-ba0a-2c80c5274362 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:51.130280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1138/2284] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:51.449793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:51.452064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:51.484376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9210b42-fb65-4b16-a616-e935b9f1c5c6 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:51.497509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52e9de-c471-4b50-9d0f-4378c8d4b524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:51.499263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e9de-c471-4b50-9d0f-4378c8d4b524 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:51.499877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e9de-c471-4b50-9d0f-4378c8d4b524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:51.501347 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e9de-c471-4b50-9d0f-4378c8d4b524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:51.505082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cc52e9de-c471-4b50-9d0f-4378c8d4b524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:51.525081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52e9de-c471-4b50-9d0f-4378c8d4b524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:51.526549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52e9de-c471-4b50-9d0f-4378c8d4b524 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:51.538589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1147/2285] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:56.263536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1f368-b56e-4f51-8c7c-f60de5e46c3f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:56.264826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1f368-b56e-4f51-8c7c-f60de5e46c3f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:56.265471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1f368-b56e-4f51-8c7c-f60de5e46c3f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:56.268366 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1139/2286] 10.222.0.55 () {54 vars in 921 bytes} [Tue Sep 13 12:37:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:37:56.318081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d93f-3d61-4372-940c-2b62039f1136 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:56.318686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d93f-3d61-4372-940c-2b62039f1136 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:56.319819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d93f-3d61-4372-940c-2b62039f1136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:56.335609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:56.357623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-92e3d93f-3d61-4372-940c-2b62039f1136 None None] MFA Rules not processed for user `3ee6a88b338342c7ab991c5511e7b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:56.360242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-92e3d93f-3d61-4372-940c-2b62039f1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:56.377698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1148/2287] 10.222.0.55 () {58 vars in 1018 bytes} [Tue Sep 13 12:37:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:56.403674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1f368-b56e-4f51-8c7c-f60de5e46c3f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:56.424292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3d93f-3d61-4372-940c-2b62039f1136 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:56.427109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-92e3d93f-3d61-4372-940c-2b62039f1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:56.428518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1f368-b56e-4f51-8c7c-f60de5e46c3f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:56.466381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f734df-9bb5-4379-97a8-8f795538d5f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:56.467395 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f734df-9bb5-4379-97a8-8f795538d5f4 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:56.468031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f734df-9bb5-4379-97a8-8f795538d5f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:56.468366 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f734df-9bb5-4379-97a8-8f795538d5f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:56.471125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3d93f-3d61-4372-940c-2b62039f1136 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:56.481041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:56.482143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:56.482843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:56.483326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] PATH_INFO: `/v3/users/e6abe049ae6a4b5db081fcc0e164075b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:56.485379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6abe049ae6a4b5db081fcc0e164075b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:56.485521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f734df-9bb5-4379-97a8-8f795538d5f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:56.487253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f734df-9bb5-4379-97a8-8f795538d5f4 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:56.489211 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:56.499645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1140/2288] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:56.580930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6abe049ae6a4b5db081fcc0e164075b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:56.600486 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6abe049ae6a4b5db081fcc0e164075b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:56.609902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6abe049ae6a4b5db081fcc0e164075b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:56.611713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6abe049ae6a4b5db081fcc0e164075b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:56.611713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2ba4a660-95a7-4fca-82d6-e499d1448cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6abe049ae6a4b5db081fcc0e164075b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:56.629060 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1149/2289] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:37:56 2022] DELETE /identity/v3/users/e6abe049ae6a4b5db081fcc0e164075b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:37:56.864435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f734df-9bb5-4379-97a8-8f795538d5f4 service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:56.886243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f734df-9bb5-4379-97a8-8f795538d5f4 service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:56.976969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:56.977676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:56.977962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:56.978238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] PATH_INFO: `/v3/projects/19e8216d030f41f2954c0b118a123eec` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:56.980103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e8216d030f41f2954c0b118a123eec)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:56.981963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:57.001503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:57.050638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e8216d030f41f2954c0b118a123eec', 'request_id': 'req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:57.059171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e8216d030f41f2954c0b118a123eec', 'request_id': 'req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:57.071344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e8216d030f41f2954c0b118a123eec', 'request_id': 'req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:57.086239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] The token cache is being invalidate because project 19e8216d030f41f2954c0b118a123eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:37:57.086791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:57.087740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1fbcb081-5fb3-46d7-a286-fc121ad1a82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:37:57.090090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1141/2290] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:37:56 2022] DELETE /identity/v3/projects/19e8216d030f41f2954c0b118a123eec => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:37:57.096121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756b2a-3f5d-4f76-83a8-54c04a2afc89 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.096441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756b2a-3f5d-4f76-83a8-54c04a2afc89 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.096719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5756b2a-3f5d-4f76-83a8-54c04a2afc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.127153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e5756b2a-3f5d-4f76-83a8-54c04a2afc89 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:57.128626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e5756b2a-3f5d-4f76-83a8-54c04a2afc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:57.214291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1150/2291] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:57.217531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fb045-5d9e-422e-8920-5b0d4bb9ac8f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.217822 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fb045-5d9e-422e-8920-5b0d4bb9ac8f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.218101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fb045-5d9e-422e-8920-5b0d4bb9ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.241638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-380fb045-5d9e-422e-8920-5b0d4bb9ac8f None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:57.243582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-380fb045-5d9e-422e-8920-5b0d4bb9ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:57.256567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1142/2292] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:57.261495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5756b2a-3f5d-4f76-83a8-54c04a2afc89 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:57.274527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5756b2a-3f5d-4f76-83a8-54c04a2afc89 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:57.281237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:57.282066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.282450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.282940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.284204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:37:57.284301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:57.286852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:57.305335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1151/2293] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:37:57.306857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fb045-5d9e-422e-8920-5b0d4bb9ac8f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:57.318384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fb045-5d9e-422e-8920-5b0d4bb9ac8f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:57.324072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b7c1-9f82-41f2-9fad-27db16c80b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:57.324738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b7c1-9f82-41f2-9fad-27db16c80b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.325026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b7c1-9f82-41f2-9fad-27db16c80b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.325300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b7c1-9f82-41f2-9fad-27db16c80b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.325978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858b7c1-9f82-41f2-9fad-27db16c80b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:57.327952 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858b7c1-9f82-41f2-9fad-27db16c80b67 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:57.368251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1143/2294] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:37:57 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:37:57.370041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:57.384546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca3097-6c0f-4dc0-ba9a-ccb0239c1505 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:57.471162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:57.486214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b3fde-0040-4d9e-a477-60f07e352f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:57.486923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b3fde-0040-4d9e-a477-60f07e352f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.487202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b3fde-0040-4d9e-a477-60f07e352f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.487595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b3fde-0040-4d9e-a477-60f07e352f98 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.488694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b3fde-0040-4d9e-a477-60f07e352f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:57.492129 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b3fde-0040-4d9e-a477-60f07e352f98 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:57.524235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1152/2295] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:37:57 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:37:57.528989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b7c1-9f82-41f2-9fad-27db16c80b67 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:57.550667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b7c1-9f82-41f2-9fad-27db16c80b67 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:57.561051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213aa7-9a78-438c-8696-89c1bb598d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:57.563077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213aa7-9a78-438c-8696-89c1bb598d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.563573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213aa7-9a78-438c-8696-89c1bb598d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.564059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213aa7-9a78-438c-8696-89c1bb598d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.565420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef213aa7-9a78-438c-8696-89c1bb598d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:57.568788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef213aa7-9a78-438c-8696-89c1bb598d20 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:57.592298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1144/2296] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:37:57.597353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b3fde-0040-4d9e-a477-60f07e352f98 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:57.615387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b3fde-0040-4d9e-a477-60f07e352f98 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:57.623768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356041ef-0e43-4bef-bae5-a9d4898c83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:57.624840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356041ef-0e43-4bef-bae5-a9d4898c83a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.625411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356041ef-0e43-4bef-bae5-a9d4898c83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.625835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356041ef-0e43-4bef-bae5-a9d4898c83a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.627171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356041ef-0e43-4bef-bae5-a9d4898c83a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:57.630338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356041ef-0e43-4bef-bae5-a9d4898c83a9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:57.650516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1153/2297] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:37:57.661392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213aa7-9a78-438c-8696-89c1bb598d20 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:57.679727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213aa7-9a78-438c-8696-89c1bb598d20 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:57.688933 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235389cc-72e8-432a-a074-4d6fe931b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:57.689956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235389cc-72e8-432a-a074-4d6fe931b504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.690661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235389cc-72e8-432a-a074-4d6fe931b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.691149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235389cc-72e8-432a-a074-4d6fe931b504 admin admin] PATH_INFO: `/v3/projects/bbc0892f90e24bc8b77ed4ec49935a66/users/3a62e66151ef483c9fd1bdaa199f728d/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.723075 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235389cc-72e8-432a-a074-4d6fe931b504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc0892f90e24bc8b77ed4ec49935a66, user_id=3a62e66151ef483c9fd1bdaa199f728d, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:57.728919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235389cc-72e8-432a-a074-4d6fe931b504 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:57.754642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1145/2298] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:37:57 2022] PUT /identity/v3/projects/bbc0892f90e24bc8b77ed4ec49935a66/users/3a62e66151ef483c9fd1bdaa199f728d/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:37:57.775499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07177-ea86-420c-abec-7b894b917fd0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:57.775928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07177-ea86-420c-abec-7b894b917fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:57.776501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07177-ea86-420c-abec-7b894b917fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:57.874782 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-19c07177-ea86-420c-abec-7b894b917fd0 None None] MFA Rules not processed for user `3a62e66151ef483c9fd1bdaa199f728d`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:57.877326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-19c07177-ea86-420c-abec-7b894b917fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:58.034843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1154/2299] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:37:58.039425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235389cc-72e8-432a-a074-4d6fe931b504 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:58.123538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235389cc-72e8-432a-a074-4d6fe931b504 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:58.129518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ede95d-54fa-456a-9f8e-a2163d884e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:58.130431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ede95d-54fa-456a-9f8e-a2163d884e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.130866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ede95d-54fa-456a-9f8e-a2163d884e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.131241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ede95d-54fa-456a-9f8e-a2163d884e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.132133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ede95d-54fa-456a-9f8e-a2163d884e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:58.134438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ede95d-54fa-456a-9f8e-a2163d884e50 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:58.177876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1146/2300] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:37:58 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:37:58.180250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c07177-ea86-420c-abec-7b894b917fd0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:58.213507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c07177-ea86-420c-abec-7b894b917fd0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:58.305018 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597302-f2dd-48d9-95a8-6b90c68cd351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:58.306005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597302-f2dd-48d9-95a8-6b90c68cd351 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.306309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597302-f2dd-48d9-95a8-6b90c68cd351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.306746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597302-f2dd-48d9-95a8-6b90c68cd351 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.306855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90814-aa2c-4657-8e11-329af014fa4e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.307224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90814-aa2c-4657-8e11-329af014fa4e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.307808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597302-f2dd-48d9-95a8-6b90c68cd351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:58.307915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90814-aa2c-4657-8e11-329af014fa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.309632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597302-f2dd-48d9-95a8-6b90c68cd351 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:58.329872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bcd90814-aa2c-4657-8e11-329af014fa4e None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:58.331210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bcd90814-aa2c-4657-8e11-329af014fa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:58.338194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1155/2301] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:37:58 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:37:58.342255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597302-f2dd-48d9-95a8-6b90c68cd351 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:58.353271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597302-f2dd-48d9-95a8-6b90c68cd351 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:58.357375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:58.359280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89076a4d-29a3-4372-acad-8d6e54e0bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:58.359919 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076a4d-29a3-4372-acad-8d6e54e0bf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.360215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076a4d-29a3-4372-acad-8d6e54e0bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.360500 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076a4d-29a3-4372-acad-8d6e54e0bf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.361585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89076a4d-29a3-4372-acad-8d6e54e0bf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:58.362801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89076a4d-29a3-4372-acad-8d6e54e0bf2e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:58.378888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1156/2302] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:37:58.381558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89076a4d-29a3-4372-acad-8d6e54e0bf2e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:58.394283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89076a4d-29a3-4372-acad-8d6e54e0bf2e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:58.400859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8674d-9919-4a26-a81e-2c2688cf12ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:58.401574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8674d-9919-4a26-a81e-2c2688cf12ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.401849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8674d-9919-4a26-a81e-2c2688cf12ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.402117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8674d-9919-4a26-a81e-2c2688cf12ce admin admin] PATH_INFO: `/v3/projects/543d6d66516649638a3ab0d25826e889/users/b28f42318d7c419db952784196764b46/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.405650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1147/2303] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:37:58.421670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8674d-9919-4a26-a81e-2c2688cf12ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=543d6d66516649638a3ab0d25826e889, user_id=b28f42318d7c419db952784196764b46, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:58.424478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8674d-9919-4a26-a81e-2c2688cf12ce admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:58.425198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90814-aa2c-4657-8e11-329af014fa4e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:58.426948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bcd90814-aa2c-4657-8e11-329af014fa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:58.443896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1157/2304] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:37:58 2022] PUT /identity/v3/projects/543d6d66516649638a3ab0d25826e889/users/b28f42318d7c419db952784196764b46/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:37:58.448425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8674d-9919-4a26-a81e-2c2688cf12ce admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:58.482336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:58.515361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90814-aa2c-4657-8e11-329af014fa4e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:58.529534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8674d-9919-4a26-a81e-2c2688cf12ce admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:58.534308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f592dd-a107-4e02-a184-4f2f19b78d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:58.535355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f592dd-a107-4e02-a184-4f2f19b78d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.535355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f592dd-a107-4e02-a184-4f2f19b78d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.535667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f592dd-a107-4e02-a184-4f2f19b78d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.536126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f592dd-a107-4e02-a184-4f2f19b78d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:58.537777 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f592dd-a107-4e02-a184-4f2f19b78d70 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:58.548227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1158/2305] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:37:58.552685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f592dd-a107-4e02-a184-4f2f19b78d70 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:58.563141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f592dd-a107-4e02-a184-4f2f19b78d70 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:58.568163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd10f20-5788-4a2b-b37d-c7570ce1a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:58.568870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd10f20-5788-4a2b-b37d-c7570ce1a271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.569147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd10f20-5788-4a2b-b37d-c7570ce1a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.569415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd10f20-5788-4a2b-b37d-c7570ce1a271 admin admin] PATH_INFO: `/v3/projects/543d6d66516649638a3ab0d25826e889/users/b28f42318d7c419db952784196764b46/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.571387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd10f20-5788-4a2b-b37d-c7570ce1a271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543d6d66516649638a3ab0d25826e889, user_id=b28f42318d7c419db952784196764b46, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:58.574102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd10f20-5788-4a2b-b37d-c7570ce1a271 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:58.581089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:58.581855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.582396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.582837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.585360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1159/2306] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:37:58 2022] PUT /identity/v3/projects/543d6d66516649638a3ab0d25826e889/users/b28f42318d7c419db952784196764b46/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:37:58.598382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd9c06-e435-4f17-b3e3-154bc8eb47ce None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.598843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd9c06-e435-4f17-b3e3-154bc8eb47ce None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.599054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd9c06-e435-4f17-b3e3-154bc8eb47ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.633803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4cfd9c06-e435-4f17-b3e3-154bc8eb47ce None None] MFA Rules not processed for user `b28f42318d7c419db952784196764b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:37:58.634922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4cfd9c06-e435-4f17-b3e3-154bc8eb47ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:58.656287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:58.657999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:58.668012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1148/2307] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:37:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:37:58.752208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1160/2308] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:37:58.765950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:58.768412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:37:58.790907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:37:58.878103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0b86-5c7e-4f6c-936d-49d2437495a9 service swift] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:58.964721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:58.965808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:58.966322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:58.966825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:58.987205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:58.991139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:59.013561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1149/2309] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:37:59.148603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd9c06-e435-4f17-b3e3-154bc8eb47ce None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:37:59.164025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd9c06-e435-4f17-b3e3-154bc8eb47ce None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:37:59.169197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc38c2-dfce-489a-8123-826786935825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:37:59.170715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc38c2-dfce-489a-8123-826786935825 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:37:59.171327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc38c2-dfce-489a-8123-826786935825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:37:59.171780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc38c2-dfce-489a-8123-826786935825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:37:59.338154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc38c2-dfce-489a-8123-826786935825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:37:59.339654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc38c2-dfce-489a-8123-826786935825 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:37:59.374612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1161/2310] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:37:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:03.524818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:03.526518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:03.592295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f1ee-0435-4856-9b52-d1f42828d7d9 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:03.600714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:03.601806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:03.602298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:03.602608 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:03.604488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:03.696974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:03.698565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:03.717824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1150/2311] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:06.310378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc38c2-dfce-489a-8123-826786935825 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:06.367520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:06.369118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:06.382574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:06.413312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:06.445103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc38c2-dfce-489a-8123-826786935825 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:06.450591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:06.451496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:06.451918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:06.452378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] PATH_INFO: `/v3/users/3a62e66151ef483c9fd1bdaa199f728d` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:06.453761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a62e66151ef483c9fd1bdaa199f728d)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:06.456198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:06.490122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba7ffd-c10b-4e17-91f6-4241d74f96e4 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:06.500026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729734f-a2ca-4a22-933c-8bd1672c4d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:06.500800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729734f-a2ca-4a22-933c-8bd1672c4d0c service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:06.501092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729734f-a2ca-4a22-933c-8bd1672c4d0c service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:06.501463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729734f-a2ca-4a22-933c-8bd1672c4d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:06.504559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d729734f-a2ca-4a22-933c-8bd1672c4d0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:06.523325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729734f-a2ca-4a22-933c-8bd1672c4d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:06.529578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729734f-a2ca-4a22-933c-8bd1672c4d0c service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:06.546173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1151/2312] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:06.554987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a62e66151ef483c9fd1bdaa199f728d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:06.572105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a62e66151ef483c9fd1bdaa199f728d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:06.584925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a62e66151ef483c9fd1bdaa199f728d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:06.585671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a62e66151ef483c9fd1bdaa199f728d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:06.588551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a62e66151ef483c9fd1bdaa199f728d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:06.604932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1162/2313] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:06 2022] DELETE /identity/v3/users/3a62e66151ef483c9fd1bdaa199f728d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:06.609710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de383be-5ed4-4a57-b7e2-f5f4f8e30fb0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:06.609892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de383be-5ed4-4a57-b7e2-f5f4f8e30fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:06.610117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de383be-5ed4-4a57-b7e2-f5f4f8e30fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:06.636325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5de383be-5ed4-4a57-b7e2-f5f4f8e30fb0 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:06.638267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5de383be-5ed4-4a57-b7e2-f5f4f8e30fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:06.741849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1152/2314] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:06.756209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:06.758475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:06.859704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daae6-4187-4a3a-8bd4-624e95ec4245 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:06.874048 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf5de4-47b9-48ac-82c6-6afc6069c0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:06.874700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5de4-47b9-48ac-82c6-6afc6069c0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:06.874983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5de4-47b9-48ac-82c6-6afc6069c0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:06.875264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5de4-47b9-48ac-82c6-6afc6069c0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:06.895814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf5de4-47b9-48ac-82c6-6afc6069c0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:06.900884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf5de4-47b9-48ac-82c6-6afc6069c0d3 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:06.944814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1163/2315] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:07.305986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de383be-5ed4-4a57-b7e2-f5f4f8e30fb0 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:07.307850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5de383be-5ed4-4a57-b7e2-f5f4f8e30fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:07.335825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de383be-5ed4-4a57-b7e2-f5f4f8e30fb0 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:07.353238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:07.353918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:07.354201 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:07.354480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] PATH_INFO: `/v3/projects/bbc0892f90e24bc8b77ed4ec49935a66` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:07.358368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc0892f90e24bc8b77ed4ec49935a66)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:07.363081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:07.474551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc0892f90e24bc8b77ed4ec49935a66', 'request_id': 'req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.496650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc0892f90e24bc8b77ed4ec49935a66', 'request_id': 'req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.518708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc0892f90e24bc8b77ed4ec49935a66', 'request_id': 'req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.547768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] The token cache is being invalidate because project bbc0892f90e24bc8b77ed4ec49935a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:07.548358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.550020 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.553288 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1153/2316] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:07 2022] DELETE /identity/v3/projects/bbc0892f90e24bc8b77ed4ec49935a66 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:07.557875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf5de4-47b9-48ac-82c6-6afc6069c0d3 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:07.570652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf5de4-47b9-48ac-82c6-6afc6069c0d3 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:07.671784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:07.697246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:07.698074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:07.698449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:07.698819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] PATH_INFO: `/v3/users/b28f42318d7c419db952784196764b46` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:07.700100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28f42318d7c419db952784196764b46)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:07.702210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:07.787694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28f42318d7c419db952784196764b46'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.804071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28f42318d7c419db952784196764b46'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.819637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28f42318d7c419db952784196764b46'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.820454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28f42318d7c419db952784196764b46'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.821091 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0ab8371d-08f4-4921-980c-019c8487fb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28f42318d7c419db952784196764b46'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:07.843587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1164/2317] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:07 2022] DELETE /identity/v3/users/b28f42318d7c419db952784196764b46 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:08.287229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:08.288004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:08.330109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe5a3e-888e-4fd4-b70a-a5c757705e08 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:08.376373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:08.422433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:08.423448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:08.424234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:08.425148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] PATH_INFO: `/v3/projects/543d6d66516649638a3ab0d25826e889` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:08.427352 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=543d6d66516649638a3ab0d25826e889)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:08.430726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:08.494077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543d6d66516649638a3ab0d25826e889', 'request_id': 'req-ad134185-48b8-484d-98b2-385fe4ba4e8f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:08.503841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543d6d66516649638a3ab0d25826e889', 'request_id': 'req-ad134185-48b8-484d-98b2-385fe4ba4e8f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:08.514389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543d6d66516649638a3ab0d25826e889', 'request_id': 'req-ad134185-48b8-484d-98b2-385fe4ba4e8f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:08.529356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] The token cache is being invalidate because project 543d6d66516649638a3ab0d25826e889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:08.529799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:08.530590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ad134185-48b8-484d-98b2-385fe4ba4e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:08.532282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1154/2318] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:08 2022] DELETE /identity/v3/projects/543d6d66516649638a3ab0d25826e889 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:08.537484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314addc-6ddc-4a63-9e04-f8a37d0b4ae1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:08.537798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314addc-6ddc-4a63-9e04-f8a37d0b4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:08.538051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314addc-6ddc-4a63-9e04-f8a37d0b4ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:08.561085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5314addc-6ddc-4a63-9e04-f8a37d0b4ae1 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:08.562354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5314addc-6ddc-4a63-9e04-f8a37d0b4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:08.671245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1165/2319] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:08.673289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989a8fd-3dc3-41f1-8c44-900b75c55145 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:08.673703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989a8fd-3dc3-41f1-8c44-900b75c55145 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:08.674078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989a8fd-3dc3-41f1-8c44-900b75c55145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:08.700547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d989a8fd-3dc3-41f1-8c44-900b75c55145 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:08.702255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d989a8fd-3dc3-41f1-8c44-900b75c55145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:08.715210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1155/2320] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:08.720061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314addc-6ddc-4a63-9e04-f8a37d0b4ae1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:08.731924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314addc-6ddc-4a63-9e04-f8a37d0b4ae1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:08.741366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:08.742474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:08.742898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:08.743477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:08.744365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:38:08.744882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:08.747355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:08.768449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1166/2321] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:38:08.772682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989a8fd-3dc3-41f1-8c44-900b75c55145 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:08.784327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989a8fd-3dc3-41f1-8c44-900b75c55145 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:08.789455 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482c6b3-0f26-438c-bce9-cb1688fe2544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:08.790085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c6b3-0f26-438c-bce9-cb1688fe2544 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:08.790365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c6b3-0f26-438c-bce9-cb1688fe2544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:08.790640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c6b3-0f26-438c-bce9-cb1688fe2544 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:08.791764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482c6b3-0f26-438c-bce9-cb1688fe2544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:08.794344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482c6b3-0f26-438c-bce9-cb1688fe2544 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:08.830166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1156/2322] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:08 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:08.834301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:08.848976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1c8dc-5279-42e0-a03e-c173f98cbdc2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:08.920496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:08.932368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8151700-af5a-4e41-8930-021c91a90a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:08.933573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8151700-af5a-4e41-8930-021c91a90a8d admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:08.934027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8151700-af5a-4e41-8930-021c91a90a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:08.934538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8151700-af5a-4e41-8930-021c91a90a8d admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:08.935306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8151700-af5a-4e41-8930-021c91a90a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:08.937821 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8151700-af5a-4e41-8930-021c91a90a8d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:08.968862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1167/2323] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:08 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:08.970246 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482c6b3-0f26-438c-bce9-cb1688fe2544 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:08.981568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482c6b3-0f26-438c-bce9-cb1688fe2544 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:08.989032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cbdd0-cad0-4fb0-968f-b8a3876cbd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:08.989423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cbdd0-cad0-4fb0-968f-b8a3876cbd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:08.989717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cbdd0-cad0-4fb0-968f-b8a3876cbd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:08.990048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cbdd0-cad0-4fb0-968f-b8a3876cbd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:08.990739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cbdd0-cad0-4fb0-968f-b8a3876cbd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:08.992427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cbdd0-cad0-4fb0-968f-b8a3876cbd4e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.010192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1157/2324] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:09.015012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8151700-af5a-4e41-8930-021c91a90a8d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.026934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8151700-af5a-4e41-8930-021c91a90a8d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:09.032180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11d83b-cfa8-472b-8a1a-4f9c97648097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:09.033020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d83b-cfa8-472b-8a1a-4f9c97648097 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.033379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d83b-cfa8-472b-8a1a-4f9c97648097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.033663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d83b-cfa8-472b-8a1a-4f9c97648097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.034445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11d83b-cfa8-472b-8a1a-4f9c97648097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:09.036315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11d83b-cfa8-472b-8a1a-4f9c97648097 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.049545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1168/2325] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:38:09.053939 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cbdd0-cad0-4fb0-968f-b8a3876cbd4e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.066713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cbdd0-cad0-4fb0-968f-b8a3876cbd4e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:09.072438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75097a2c-bcb2-440a-8970-b1a80ff3761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:09.072738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75097a2c-bcb2-440a-8970-b1a80ff3761b admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.072900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75097a2c-bcb2-440a-8970-b1a80ff3761b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.073197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75097a2c-bcb2-440a-8970-b1a80ff3761b admin admin] PATH_INFO: `/v3/projects/7a67340bd05f459c9ecca8e0d423e5a9/users/59fb4176ebf841708713b9ad83d76ae4/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.097857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75097a2c-bcb2-440a-8970-b1a80ff3761b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a67340bd05f459c9ecca8e0d423e5a9, user_id=59fb4176ebf841708713b9ad83d76ae4, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:09.100732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75097a2c-bcb2-440a-8970-b1a80ff3761b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.131084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1158/2326] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:09 2022] PUT /identity/v3/projects/7a67340bd05f459c9ecca8e0d423e5a9/users/59fb4176ebf841708713b9ad83d76ae4/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:09.133349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527bb31-1d9a-4ab2-bfb7-f9517ed7925d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.133606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527bb31-1d9a-4ab2-bfb7-f9517ed7925d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.133942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527bb31-1d9a-4ab2-bfb7-f9517ed7925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.179075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d527bb31-1d9a-4ab2-bfb7-f9517ed7925d None None] MFA Rules not processed for user `59fb4176ebf841708713b9ad83d76ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:09.180341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d527bb31-1d9a-4ab2-bfb7-f9517ed7925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:09.255130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1169/2327] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:09.259707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75097a2c-bcb2-440a-8970-b1a80ff3761b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.338921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:09.343557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75097a2c-bcb2-440a-8970-b1a80ff3761b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:09.350614 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377552-30f6-4ba5-8878-aa091a649128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:09.351487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377552-30f6-4ba5-8878-aa091a649128 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.352511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377552-30f6-4ba5-8878-aa091a649128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.352842 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377552-30f6-4ba5-8878-aa091a649128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.353530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377552-30f6-4ba5-8878-aa091a649128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:09.355703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377552-30f6-4ba5-8878-aa091a649128 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.394403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1159/2328] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:09 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:09.395984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527bb31-1d9a-4ab2-bfb7-f9517ed7925d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.414893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527bb31-1d9a-4ab2-bfb7-f9517ed7925d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:09.509833 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4a0ce-676b-466b-90e0-5272ece8cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:09.510588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4a0ce-676b-466b-90e0-5272ece8cf9c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.511021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4a0ce-676b-466b-90e0-5272ece8cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.511293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4a0ce-676b-466b-90e0-5272ece8cf9c admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.512013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4a0ce-676b-466b-90e0-5272ece8cf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:09.514413 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4a0ce-676b-466b-90e0-5272ece8cf9c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.541100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1170/2329] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:09 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:38:09.547229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377552-30f6-4ba5-8878-aa091a649128 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.557541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377552-30f6-4ba5-8878-aa091a649128 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:09.562548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0a571-ee34-4ffc-a58d-fe41f70985e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:09.564420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a571-ee34-4ffc-a58d-fe41f70985e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.564420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a571-ee34-4ffc-a58d-fe41f70985e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.564420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a571-ee34-4ffc-a58d-fe41f70985e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.566673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0a571-ee34-4ffc-a58d-fe41f70985e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:09.567347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0a571-ee34-4ffc-a58d-fe41f70985e3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.586624 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1160/2330] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:09.591209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4a0ce-676b-466b-90e0-5272ece8cf9c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.602780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4a0ce-676b-466b-90e0-5272ece8cf9c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:09.608043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279b47-08b4-422e-93f3-eb6f4387b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:09.608812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279b47-08b4-422e-93f3-eb6f4387b6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.609093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279b47-08b4-422e-93f3-eb6f4387b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.609373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279b47-08b4-422e-93f3-eb6f4387b6fe admin admin] PATH_INFO: `/v3/projects/f7bba61933994cb4bc36d9a4866fe8c3/users/bef4e4ac444c49e99eefbe8c6842c8b9/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.631935 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279b47-08b4-422e-93f3-eb6f4387b6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7bba61933994cb4bc36d9a4866fe8c3, user_id=bef4e4ac444c49e99eefbe8c6842c8b9, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:09.635187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279b47-08b4-422e-93f3-eb6f4387b6fe admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.657388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1171/2331] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:09 2022] PUT /identity/v3/projects/f7bba61933994cb4bc36d9a4866fe8c3/users/bef4e4ac444c49e99eefbe8c6842c8b9/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:09.663838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0a571-ee34-4ffc-a58d-fe41f70985e3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.674786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0a571-ee34-4ffc-a58d-fe41f70985e3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:09.751167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac08a-04ed-442b-b2b5-796080aba46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:09.751821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac08a-04ed-442b-b2b5-796080aba46d admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.752145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac08a-04ed-442b-b2b5-796080aba46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.752437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac08a-04ed-442b-b2b5-796080aba46d admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.753141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac08a-04ed-442b-b2b5-796080aba46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:09.755092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac08a-04ed-442b-b2b5-796080aba46d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.767505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1161/2332] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:38:09.772166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279b47-08b4-422e-93f3-eb6f4387b6fe admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.783502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279b47-08b4-422e-93f3-eb6f4387b6fe admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:09.788955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:09.789759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.790213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.790580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] PATH_INFO: `/v3/projects/f7bba61933994cb4bc36d9a4866fe8c3/users/bef4e4ac444c49e99eefbe8c6842c8b9/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.792814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7bba61933994cb4bc36d9a4866fe8c3, user_id=bef4e4ac444c49e99eefbe8c6842c8b9, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:09.795621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:09.807264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1172/2333] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:09 2022] PUT /identity/v3/projects/f7bba61933994cb4bc36d9a4866fe8c3/users/bef4e4ac444c49e99eefbe8c6842c8b9/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:09.818224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59dcc-1baa-4642-9390-994b01e7cf63 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:09.818570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59dcc-1baa-4642-9390-994b01e7cf63 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:09.818782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59dcc-1baa-4642-9390-994b01e7cf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:09.850984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ace59dcc-1baa-4642-9390-994b01e7cf63 None None] MFA Rules not processed for user `bef4e4ac444c49e99eefbe8c6842c8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:09.852660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ace59dcc-1baa-4642-9390-994b01e7cf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:09.958593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1162/2334] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:09.971749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:09.974038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:09.996329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:10.050209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58085-1f22-417e-9f0a-38f55f711202 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:10.054792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:10.055917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:10.055917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:10.056160 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:10.119876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:10.121370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:10.131044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1173/2335] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:12.781488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace59dcc-1baa-4642-9390-994b01e7cf63 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:12.792379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace59dcc-1baa-4642-9390-994b01e7cf63 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:12.796097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:12.796743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:12.797021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:12.797294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:12.806558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:12.808013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:12.818071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1163/2336] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:14.536642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:14.538335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:14.602114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cce8d-7f77-4ba7-a362-124b1cfc909d service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:14.607511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b4af3-0bc6-4009-afc0-56b8d68d5d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:14.608162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4af3-0bc6-4009-afc0-56b8d68d5d95 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:14.608493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4af3-0bc6-4009-afc0-56b8d68d5d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:14.608741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4af3-0bc6-4009-afc0-56b8d68d5d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:14.610475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2e1b4af3-0bc6-4009-afc0-56b8d68d5d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:14.621015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b4af3-0bc6-4009-afc0-56b8d68d5d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:14.622535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b4af3-0bc6-4009-afc0-56b8d68d5d95 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:14.631135 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1174/2337] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:15.270848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:15.272325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:15.320472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:15.364104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e443902-aea5-4c66-a791-2bbd84312569 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:15.370005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:15.370632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:15.370913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:15.371186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:15.372972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:15.386064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:15.388100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:15.400296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1164/2338] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:17.558064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ead60c-b830-4ad4-8127-084e10f5ff18 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:17.558583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ead60c-b830-4ad4-8127-084e10f5ff18 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:17.558714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ead60c-b830-4ad4-8127-084e10f5ff18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:17.580401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e4ead60c-b830-4ad4-8127-084e10f5ff18 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:17.581649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e4ead60c-b830-4ad4-8127-084e10f5ff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:17.642234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1175/2339] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:38:17.654834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:17.656435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:17.728264 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6994-07b0-4dbe-ad08-5f67c1ea6565 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:17.733705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cf8d4-dc58-4494-ab3b-2d91142cc4ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:17.734319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf8d4-dc58-4494-ab3b-2d91142cc4ec service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:17.734595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf8d4-dc58-4494-ab3b-2d91142cc4ec service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:17.734865 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf8d4-dc58-4494-ab3b-2d91142cc4ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:17.744268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cf8d4-dc58-4494-ab3b-2d91142cc4ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:17.745900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cf8d4-dc58-4494-ab3b-2d91142cc4ec service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:17.754327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1165/2340] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:38:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:38:25.930957 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ead60c-b830-4ad4-8127-084e10f5ff18 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:25.950314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:26.040970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ead60c-b830-4ad4-8127-084e10f5ff18 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:26.046687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:26.047319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:26.047665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:26.047946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] PATH_INFO: `/v3/users/59fb4176ebf841708713b9ad83d76ae4` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:26.049373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fb4176ebf841708713b9ad83d76ae4)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:26.051343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:26.111005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fb4176ebf841708713b9ad83d76ae4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.123847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fb4176ebf841708713b9ad83d76ae4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.135370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fb4176ebf841708713b9ad83d76ae4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.137592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fb4176ebf841708713b9ad83d76ae4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.137592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fb4176ebf841708713b9ad83d76ae4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.150544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1176/2341] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:25 2022] DELETE /identity/v3/users/59fb4176ebf841708713b9ad83d76ae4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:26.155502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42d6d-08fa-43b6-87a9-95a603cd4896 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:26.156050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42d6d-08fa-43b6-87a9-95a603cd4896 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:26.156050 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42d6d-08fa-43b6-87a9-95a603cd4896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:26.213315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bae42d6d-08fa-43b6-87a9-95a603cd4896 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:26.214725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bae42d6d-08fa-43b6-87a9-95a603cd4896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:26.279356 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1166/2342] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:26.289337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:26.290750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:26.357311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:26.395944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279392-cee9-4cb1-b975-a53599775ab3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:26.400125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd5b96-5d58-4107-8963-362785aa52f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:26.400772 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd5b96-5d58-4107-8963-362785aa52f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:26.401072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd5b96-5d58-4107-8963-362785aa52f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:26.401548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd5b96-5d58-4107-8963-362785aa52f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:26.410978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd5b96-5d58-4107-8963-362785aa52f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:26.412414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd5b96-5d58-4107-8963-362785aa52f9 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:26.422104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1177/2343] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:26.711777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42d6d-08fa-43b6-87a9-95a603cd4896 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:26.713283 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bae42d6d-08fa-43b6-87a9-95a603cd4896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:26.725948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42d6d-08fa-43b6-87a9-95a603cd4896 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:26.731484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:26.732133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:26.732579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:26.732857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] PATH_INFO: `/v3/projects/7a67340bd05f459c9ecca8e0d423e5a9` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:26.734070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a67340bd05f459c9ecca8e0d423e5a9)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:26.736002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:26.763010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:26.790422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a67340bd05f459c9ecca8e0d423e5a9', 'request_id': 'req-8390029d-cd2f-49db-8f1d-9bf3f92dad69'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.797457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a67340bd05f459c9ecca8e0d423e5a9', 'request_id': 'req-8390029d-cd2f-49db-8f1d-9bf3f92dad69'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.806835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a67340bd05f459c9ecca8e0d423e5a9', 'request_id': 'req-8390029d-cd2f-49db-8f1d-9bf3f92dad69'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.817981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] The token cache is being invalidate because project 7a67340bd05f459c9ecca8e0d423e5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:26.818270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.818923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.820432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1167/2344] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:26 2022] DELETE /identity/v3/projects/7a67340bd05f459c9ecca8e0d423e5a9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:26.824814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd5b96-5d58-4107-8963-362785aa52f9 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:26.835145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd5b96-5d58-4107-8963-362785aa52f9 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:26.898819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:26.899365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:26.899646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:26.899904 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] PATH_INFO: `/v3/users/bef4e4ac444c49e99eefbe8c6842c8b9` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:26.901180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef4e4ac444c49e99eefbe8c6842c8b9)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:26.903399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:26.958236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef4e4ac444c49e99eefbe8c6842c8b9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.971201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef4e4ac444c49e99eefbe8c6842c8b9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.981414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef4e4ac444c49e99eefbe8c6842c8b9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.982074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef4e4ac444c49e99eefbe8c6842c8b9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.982685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-59065421-4eea-476c-86f7-815b4b8dd3d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef4e4ac444c49e99eefbe8c6842c8b9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:26.997513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1178/2345] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:26 2022] DELETE /identity/v3/users/bef4e4ac444c49e99eefbe8c6842c8b9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:38:27.278351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:27.279915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:27.295864 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390029d-cd2f-49db-8f1d-9bf3f92dad69 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:27.355829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:27.356631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.356913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.357186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] PATH_INFO: `/v3/projects/f7bba61933994cb4bc36d9a4866fe8c3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.358354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7bba61933994cb4bc36d9a4866fe8c3)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:27.360301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:27.412175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7bba61933994cb4bc36d9a4866fe8c3', 'request_id': 'req-f6f12672-54f2-4f03-b54e-56cec2b4ed99'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:27.419734 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7bba61933994cb4bc36d9a4866fe8c3', 'request_id': 'req-f6f12672-54f2-4f03-b54e-56cec2b4ed99'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:27.428747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7bba61933994cb4bc36d9a4866fe8c3', 'request_id': 'req-f6f12672-54f2-4f03-b54e-56cec2b4ed99'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:27.446162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] The token cache is being invalidate because project f7bba61933994cb4bc36d9a4866fe8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:27.446460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:27.447203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f6f12672-54f2-4f03-b54e-56cec2b4ed99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:27.448931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1168/2346] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:27 2022] DELETE /identity/v3/projects/f7bba61933994cb4bc36d9a4866fe8c3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:27.454240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f9a29-09cf-4c58-9e88-64180b0e9c0c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.454525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f9a29-09cf-4c58-9e88-64180b0e9c0c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.454797 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f9a29-09cf-4c58-9e88-64180b0e9c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.510212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7b0f9a29-09cf-4c58-9e88-64180b0e9c0c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:27.512361 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7b0f9a29-09cf-4c58-9e88-64180b0e9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:27.525548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:27.576886 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1179/2347] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:27.585382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cce7-d7c8-469d-970b-5892846e517b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.585795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cce7-d7c8-469d-970b-5892846e517b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.586169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cce7-d7c8-469d-970b-5892846e517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.607329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ff36cce7-d7c8-469d-970b-5892846e517b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:27.608593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ff36cce7-d7c8-469d-970b-5892846e517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:27.616849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1169/2348] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:27.623039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f9a29-09cf-4c58-9e88-64180b0e9c0c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:27.633187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f9a29-09cf-4c58-9e88-64180b0e9c0c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:27.640932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:27.641831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.642222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.642637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.643517 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:38:27.643956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:27.646220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:27.664274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1180/2349] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:38:27.669926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36cce7-d7c8-469d-970b-5892846e517b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:27.679930 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36cce7-d7c8-469d-970b-5892846e517b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:27.686802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6909d8b-23d4-434b-bd8d-2a3895750d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:27.687407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909d8b-23d4-434b-bd8d-2a3895750d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.687683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909d8b-23d4-434b-bd8d-2a3895750d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.687956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909d8b-23d4-434b-bd8d-2a3895750d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.688630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6909d8b-23d4-434b-bd8d-2a3895750d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:27.690544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6909d8b-23d4-434b-bd8d-2a3895750d27 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:27.732650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1170/2350] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:27 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:27.738714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:27.749873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2ac5-be94-4a38-a0d2-05209db228d9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:27.815266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7235b-9d64-428d-93c7-231a10704223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:27.815866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7235b-9d64-428d-93c7-231a10704223 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.816201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7235b-9d64-428d-93c7-231a10704223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.816453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7235b-9d64-428d-93c7-231a10704223 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.817113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7235b-9d64-428d-93c7-231a10704223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:27.819088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7235b-9d64-428d-93c7-231a10704223 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:27.843970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1181/2351] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:27 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:27.848292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6909d8b-23d4-434b-bd8d-2a3895750d27 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:27.855581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:27.860026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6909d8b-23d4-434b-bd8d-2a3895750d27 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:27.868337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d54b-b7e5-4c3f-8d94-437231d126fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:27.869227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d54b-b7e5-4c3f-8d94-437231d126fa admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.869716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d54b-b7e5-4c3f-8d94-437231d126fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.870577 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d54b-b7e5-4c3f-8d94-437231d126fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.871141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d54b-b7e5-4c3f-8d94-437231d126fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:27.872790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d54b-b7e5-4c3f-8d94-437231d126fa admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:27.883582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1171/2352] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:38:27.888244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7235b-9d64-428d-93c7-231a10704223 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:27.900242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7235b-9d64-428d-93c7-231a10704223 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:27.907412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebe1d6-77c2-4669-96b2-2697ea1b895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:27.908026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe1d6-77c2-4669-96b2-2697ea1b895c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.908306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe1d6-77c2-4669-96b2-2697ea1b895c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.908598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe1d6-77c2-4669-96b2-2697ea1b895c admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.909243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebe1d6-77c2-4669-96b2-2697ea1b895c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:27.910873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebe1d6-77c2-4669-96b2-2697ea1b895c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:27.922652 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1182/2353] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:27.927661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d54b-b7e5-4c3f-8d94-437231d126fa admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:27.940218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d54b-b7e5-4c3f-8d94-437231d126fa admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:27.946220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3bee1-e72f-453c-b15f-920c337233cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:27.946928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3bee1-e72f-453c-b15f-920c337233cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.947099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3bee1-e72f-453c-b15f-920c337233cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.947402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3bee1-e72f-453c-b15f-920c337233cf admin admin] PATH_INFO: `/v3/projects/d6fcc7de3a984767a2f64759dc099e54/users/61f1260f8d274392bf2e4ef23cdf8d3d/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:27.965299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3bee1-e72f-453c-b15f-920c337233cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fcc7de3a984767a2f64759dc099e54, user_id=61f1260f8d274392bf2e4ef23cdf8d3d, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:27.968018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3bee1-e72f-453c-b15f-920c337233cf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:27.982391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1172/2354] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:27 2022] PUT /identity/v3/projects/d6fcc7de3a984767a2f64759dc099e54/users/61f1260f8d274392bf2e4ef23cdf8d3d/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:27.992846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c58e1-6d98-43de-a917-b82b7d0ac16d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:27.993328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c58e1-6d98-43de-a917-b82b7d0ac16d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:27.993420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c58e1-6d98-43de-a917-b82b7d0ac16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.024738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dd9c58e1-6d98-43de-a917-b82b7d0ac16d None None] MFA Rules not processed for user `61f1260f8d274392bf2e4ef23cdf8d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:28.025962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dd9c58e1-6d98-43de-a917-b82b7d0ac16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:28.097576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1183/2355] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:28.102288 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3bee1-e72f-453c-b15f-920c337233cf admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:28.176926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3bee1-e72f-453c-b15f-920c337233cf admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:28.184901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e274412-cd30-4d97-83a0-5015567f8610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:28.186226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e274412-cd30-4d97-83a0-5015567f8610 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.186648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e274412-cd30-4d97-83a0-5015567f8610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.187124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e274412-cd30-4d97-83a0-5015567f8610 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.188241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e274412-cd30-4d97-83a0-5015567f8610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:28.192122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e274412-cd30-4d97-83a0-5015567f8610 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:28.226840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1173/2356] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:28 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:28.228675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c58e1-6d98-43de-a917-b82b7d0ac16d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:28.240532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c58e1-6d98-43de-a917-b82b7d0ac16d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:28.250432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:28.307632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20f642-12b2-4c7c-a34e-d35b5c5338d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:28.308323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20f642-12b2-4c7c-a34e-d35b5c5338d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.309133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20f642-12b2-4c7c-a34e-d35b5c5338d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.309405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20f642-12b2-4c7c-a34e-d35b5c5338d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.310035 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20f642-12b2-4c7c-a34e-d35b5c5338d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:28.311978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20f642-12b2-4c7c-a34e-d35b5c5338d1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:28.343932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1184/2357] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:28 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:28.349778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e274412-cd30-4d97-83a0-5015567f8610 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:28.362965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e274412-cd30-4d97-83a0-5015567f8610 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:28.368577 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc48de-1f77-45e4-ab88-68b90a30f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:28.369194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc48de-1f77-45e4-ab88-68b90a30f376 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.369476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc48de-1f77-45e4-ab88-68b90a30f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.369750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc48de-1f77-45e4-ab88-68b90a30f376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.370399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc48de-1f77-45e4-ab88-68b90a30f376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:28.372067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc48de-1f77-45e4-ab88-68b90a30f376 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:28.383539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1174/2358] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:28.388470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20f642-12b2-4c7c-a34e-d35b5c5338d1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:28.398719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20f642-12b2-4c7c-a34e-d35b5c5338d1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:28.404314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5bcb-b974-4c88-91eb-7b9a7990947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:28.405004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5bcb-b974-4c88-91eb-7b9a7990947b admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.405279 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5bcb-b974-4c88-91eb-7b9a7990947b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.405557 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5bcb-b974-4c88-91eb-7b9a7990947b admin admin] PATH_INFO: `/v3/projects/261a5565cef44ca5ad603f6c107c1109/users/1822aefaed3c436daf415eeb830f557b/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.421520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc5bcb-b974-4c88-91eb-7b9a7990947b admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a5565cef44ca5ad603f6c107c1109, user_id=1822aefaed3c436daf415eeb830f557b, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:28.424228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc5bcb-b974-4c88-91eb-7b9a7990947b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:28.441614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1185/2359] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:28 2022] PUT /identity/v3/projects/261a5565cef44ca5ad603f6c107c1109/users/1822aefaed3c436daf415eeb830f557b/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:28.445866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc48de-1f77-45e4-ab88-68b90a30f376 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:28.457152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc48de-1f77-45e4-ab88-68b90a30f376 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:28.519144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fc1b2-d4b9-4102-b134-f620dbcd708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:28.519772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc1b2-d4b9-4102-b134-f620dbcd708b admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.520069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc1b2-d4b9-4102-b134-f620dbcd708b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.520343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc1b2-d4b9-4102-b134-f620dbcd708b admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.521027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fc1b2-d4b9-4102-b134-f620dbcd708b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:28.522703 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fc1b2-d4b9-4102-b134-f620dbcd708b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:28.533196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1175/2360] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:28.537630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5bcb-b974-4c88-91eb-7b9a7990947b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:28.549265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5bcb-b974-4c88-91eb-7b9a7990947b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:28.554380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:28.555084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.555363 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.555640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] PATH_INFO: `/v3/projects/261a5565cef44ca5ad603f6c107c1109/users/1822aefaed3c436daf415eeb830f557b/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.557693 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a5565cef44ca5ad603f6c107c1109, user_id=1822aefaed3c436daf415eeb830f557b, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:28.560561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:28.582215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1186/2361] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:28 2022] PUT /identity/v3/projects/261a5565cef44ca5ad603f6c107c1109/users/1822aefaed3c436daf415eeb830f557b/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:28.599714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828695d4-f2f2-44ae-bf88-31decb1dcb99 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.599995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828695d4-f2f2-44ae-bf88-31decb1dcb99 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.600355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828695d4-f2f2-44ae-bf88-31decb1dcb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.633483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-828695d4-f2f2-44ae-bf88-31decb1dcb99 None None] MFA Rules not processed for user `1822aefaed3c436daf415eeb830f557b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:28.634863 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-828695d4-f2f2-44ae-bf88-31decb1dcb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:28.666575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:28.716946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1176/2362] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:28.728415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:28.730267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:28.822564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4623b24-8df6-4fa5-a5d4-51e48416e2ce admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:28.838105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322aa6e-76f2-497c-9b46-acd17a277f63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:28.838796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322aa6e-76f2-497c-9b46-acd17a277f63 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.839109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322aa6e-76f2-497c-9b46-acd17a277f63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.839401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322aa6e-76f2-497c-9b46-acd17a277f63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.857280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322aa6e-76f2-497c-9b46-acd17a277f63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:28.858755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322aa6e-76f2-497c-9b46-acd17a277f63 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:28.869341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1187/2363] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:28.901765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828695d4-f2f2-44ae-bf88-31decb1dcb99 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:28.975242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828695d4-f2f2-44ae-bf88-31decb1dcb99 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:28.980790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:28.981425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:28.981714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:28.981991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] PATH_INFO: `/v3/users/61f1260f8d274392bf2e4ef23cdf8d3d` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:28.983169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f1260f8d274392bf2e4ef23cdf8d3d)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:28.985157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:29.040285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f1260f8d274392bf2e4ef23cdf8d3d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.051400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f1260f8d274392bf2e4ef23cdf8d3d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.052054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f1260f8d274392bf2e4ef23cdf8d3d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.052708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f1260f8d274392bf2e4ef23cdf8d3d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.060358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f1260f8d274392bf2e4ef23cdf8d3d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.078543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1177/2364] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:28 2022] DELETE /identity/v3/users/61f1260f8d274392bf2e4ef23cdf8d3d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:29.083221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43263a9-ad70-46f3-b114-1f25f4ac3a74 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:29.083764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43263a9-ad70-46f3-b114-1f25f4ac3a74 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:29.083764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43263a9-ad70-46f3-b114-1f25f4ac3a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:29.103273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f43263a9-ad70-46f3-b114-1f25f4ac3a74 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:29.104519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f43263a9-ad70-46f3-b114-1f25f4ac3a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:29.158688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:29.182341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1188/2365] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:29.192896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:29.194482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:29.248040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:29.262750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b744a8-4ddc-4338-9f9a-e687d83cfd3d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:29.267107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f14aa-8f98-4e96-82cf-cbd38a9334c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:29.267897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f14aa-8f98-4e96-82cf-cbd38a9334c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:29.268206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f14aa-8f98-4e96-82cf-cbd38a9334c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:29.268525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f14aa-8f98-4e96-82cf-cbd38a9334c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:29.278478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f14aa-8f98-4e96-82cf-cbd38a9334c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:29.279929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f14aa-8f98-4e96-82cf-cbd38a9334c6 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:29.290377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1178/2366] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:29.673008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43263a9-ad70-46f3-b114-1f25f4ac3a74 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:29.674889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f43263a9-ad70-46f3-b114-1f25f4ac3a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:29.687744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43263a9-ad70-46f3-b114-1f25f4ac3a74 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:29.692934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:29.693588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:29.693874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:29.694142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] PATH_INFO: `/v3/projects/d6fcc7de3a984767a2f64759dc099e54` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:29.695319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fcc7de3a984767a2f64759dc099e54)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:29.697332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:29.748012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fcc7de3a984767a2f64759dc099e54', 'request_id': 'req-3326ca0f-8cae-463e-86cb-4cf512af3c25'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.757926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fcc7de3a984767a2f64759dc099e54', 'request_id': 'req-3326ca0f-8cae-463e-86cb-4cf512af3c25'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.765430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fcc7de3a984767a2f64759dc099e54', 'request_id': 'req-3326ca0f-8cae-463e-86cb-4cf512af3c25'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.778362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] The token cache is being invalidate because project d6fcc7de3a984767a2f64759dc099e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:29.778649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.779298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.780831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1189/2367] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:29 2022] DELETE /identity/v3/projects/d6fcc7de3a984767a2f64759dc099e54 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:29.785809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f14aa-8f98-4e96-82cf-cbd38a9334c6 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:29.796808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f14aa-8f98-4e96-82cf-cbd38a9334c6 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:29.860181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:29.861190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:29.861477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:29.861747 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] PATH_INFO: `/v3/users/1822aefaed3c436daf415eeb830f557b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:29.862895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1822aefaed3c436daf415eeb830f557b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:29.864900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:29.917019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1822aefaed3c436daf415eeb830f557b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.928260 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1822aefaed3c436daf415eeb830f557b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.929590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1822aefaed3c436daf415eeb830f557b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.930205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1822aefaed3c436daf415eeb830f557b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.938602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a208db39-ab91-4e41-8e5d-1f1cfa5b3749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1822aefaed3c436daf415eeb830f557b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:29.956236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1179/2368] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:29 2022] DELETE /identity/v3/users/1822aefaed3c436daf415eeb830f557b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:30.270683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:30.272257 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:30.286818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ca0f-8cae-463e-86cb-4cf512af3c25 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:30.353317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:30.353949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.354222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.354488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] PATH_INFO: `/v3/projects/261a5565cef44ca5ad603f6c107c1109` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:30.355775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261a5565cef44ca5ad603f6c107c1109)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:30.357739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:30.410236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261a5565cef44ca5ad603f6c107c1109', 'request_id': 'req-0201585e-905a-49a4-b7be-7346ea708773'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:30.419539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261a5565cef44ca5ad603f6c107c1109', 'request_id': 'req-0201585e-905a-49a4-b7be-7346ea708773'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:30.426576 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261a5565cef44ca5ad603f6c107c1109', 'request_id': 'req-0201585e-905a-49a4-b7be-7346ea708773'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:30.439420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] The token cache is being invalidate because project 261a5565cef44ca5ad603f6c107c1109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:30.439712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:30.440519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0201585e-905a-49a4-b7be-7346ea708773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:30.442109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1190/2369] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:30 2022] DELETE /identity/v3/projects/261a5565cef44ca5ad603f6c107c1109 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:30.447304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98607415-072d-46be-8c36-78f1ad70d705 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.447591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98607415-072d-46be-8c36-78f1ad70d705 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.447868 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98607415-072d-46be-8c36-78f1ad70d705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:30.470181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-98607415-072d-46be-8c36-78f1ad70d705 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:30.471387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-98607415-072d-46be-8c36-78f1ad70d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:30.540475 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1180/2370] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:30.551062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6810d-3ea6-4d3f-b9fa-408ddec22578 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.551062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6810d-3ea6-4d3f-b9fa-408ddec22578 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.551062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6810d-3ea6-4d3f-b9fa-408ddec22578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:30.559728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:30.577146 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-abc6810d-3ea6-4d3f-b9fa-408ddec22578 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:30.579241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-abc6810d-3ea6-4d3f-b9fa-408ddec22578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:30.588188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1191/2371] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:30.593383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98607415-072d-46be-8c36-78f1ad70d705 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:30.604808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98607415-072d-46be-8c36-78f1ad70d705 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:30.609737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:30.610355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.610636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.610909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:30.611579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:38:30.611877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:30.613504 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:30.615216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:30.630284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1181/2372] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:38:30.634839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6810d-3ea6-4d3f-b9fa-408ddec22578 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:30.646124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6810d-3ea6-4d3f-b9fa-408ddec22578 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:30.651269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235855a2-727c-4702-8891-8e63e4389d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:30.651880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235855a2-727c-4702-8891-8e63e4389d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.652170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235855a2-727c-4702-8891-8e63e4389d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.652452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235855a2-727c-4702-8891-8e63e4389d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:30.653102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235855a2-727c-4702-8891-8e63e4389d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:30.655023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235855a2-727c-4702-8891-8e63e4389d9b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:30.689167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1192/2373] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:30 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:30.693974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:30.707503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397c46f-b3b5-4809-b224-11f1355ec5a2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:30.812694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6c63-3348-4c44-9284-1137275ec31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:30.813820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6c63-3348-4c44-9284-1137275ec31d admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.814002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6c63-3348-4c44-9284-1137275ec31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.814361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6c63-3348-4c44-9284-1137275ec31d admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:30.816900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb6c63-3348-4c44-9284-1137275ec31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:30.819303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb6c63-3348-4c44-9284-1137275ec31d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:30.870748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1182/2374] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:30 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:30.875267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235855a2-727c-4702-8891-8e63e4389d9b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:30.892539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235855a2-727c-4702-8891-8e63e4389d9b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:30.908424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04127f8d-b1ce-456f-9fce-84cea0273c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:30.909041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04127f8d-b1ce-456f-9fce-84cea0273c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.909406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04127f8d-b1ce-456f-9fce-84cea0273c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.909709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04127f8d-b1ce-456f-9fce-84cea0273c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:30.910444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04127f8d-b1ce-456f-9fce-84cea0273c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:30.912361 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04127f8d-b1ce-456f-9fce-84cea0273c37 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:30.926008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1193/2375] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:30.930292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6c63-3348-4c44-9284-1137275ec31d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:30.945513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6c63-3348-4c44-9284-1137275ec31d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:30.951202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73601739-baa5-4509-aa49-dd5726fca63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:30.951839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601739-baa5-4509-aa49-dd5726fca63b admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.952094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601739-baa5-4509-aa49-dd5726fca63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.952379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601739-baa5-4509-aa49-dd5726fca63b admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:30.953100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73601739-baa5-4509-aa49-dd5726fca63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:30.955554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73601739-baa5-4509-aa49-dd5726fca63b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:30.969254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1183/2376] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:30.976585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04127f8d-b1ce-456f-9fce-84cea0273c37 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:30.987640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04127f8d-b1ce-456f-9fce-84cea0273c37 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:30.992655 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75c931-b6a2-4a8d-87b5-e8104728c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:30.993354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c931-b6a2-4a8d-87b5-e8104728c5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:30.993633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c931-b6a2-4a8d-87b5-e8104728c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:30.993929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c931-b6a2-4a8d-87b5-e8104728c5c0 admin admin] PATH_INFO: `/v3/projects/1883bdd6bd3f49ee9da4fc2c1e567a88/users/b37cc462da4f4c23b2e666f425c83d32/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.011079 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75c931-b6a2-4a8d-87b5-e8104728c5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1883bdd6bd3f49ee9da4fc2c1e567a88, user_id=b37cc462da4f4c23b2e666f425c83d32, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:31.014368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75c931-b6a2-4a8d-87b5-e8104728c5c0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:31.030393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1194/2377] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:30 2022] PUT /identity/v3/projects/1883bdd6bd3f49ee9da4fc2c1e567a88/users/b37cc462da4f4c23b2e666f425c83d32/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:31.042237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2af3b-eb8b-46aa-91d3-0c772dd301ad None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.043152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2af3b-eb8b-46aa-91d3-0c772dd301ad None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.043548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2af3b-eb8b-46aa-91d3-0c772dd301ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.073274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f4f2af3b-eb8b-46aa-91d3-0c772dd301ad None None] MFA Rules not processed for user `b37cc462da4f4c23b2e666f425c83d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:31.074718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f4f2af3b-eb8b-46aa-91d3-0c772dd301ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:31.146601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1184/2378] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:31.151547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75c931-b6a2-4a8d-87b5-e8104728c5c0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:31.232516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75c931-b6a2-4a8d-87b5-e8104728c5c0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:31.238287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d15d3f-2fa6-43a7-8474-c171d29813a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:31.238898 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15d3f-2fa6-43a7-8474-c171d29813a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.239171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15d3f-2fa6-43a7-8474-c171d29813a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.239433 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15d3f-2fa6-43a7-8474-c171d29813a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.240086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d15d3f-2fa6-43a7-8474-c171d29813a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:31.242039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d15d3f-2fa6-43a7-8474-c171d29813a5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:31.273387 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1195/2379] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:31 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:31.277777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2af3b-eb8b-46aa-91d3-0c772dd301ad None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:31.289028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2af3b-eb8b-46aa-91d3-0c772dd301ad None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:31.349639 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbc5b3-e7a6-4513-863c-ffe830893543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:31.350181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc5b3-e7a6-4513-863c-ffe830893543 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.350452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc5b3-e7a6-4513-863c-ffe830893543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.350744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc5b3-e7a6-4513-863c-ffe830893543 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.351402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbc5b3-e7a6-4513-863c-ffe830893543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:31.353402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbc5b3-e7a6-4513-863c-ffe830893543 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:31.363059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:31.381702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1185/2380] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:31 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:38:31.382922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d15d3f-2fa6-43a7-8474-c171d29813a5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:31.397459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d15d3f-2fa6-43a7-8474-c171d29813a5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:31.402511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04ee9e-03fb-4f7a-90b9-ca22c5bcf212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:31.403227 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04ee9e-03fb-4f7a-90b9-ca22c5bcf212 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.403506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04ee9e-03fb-4f7a-90b9-ca22c5bcf212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.403779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04ee9e-03fb-4f7a-90b9-ca22c5bcf212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.404424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04ee9e-03fb-4f7a-90b9-ca22c5bcf212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:31.406062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04ee9e-03fb-4f7a-90b9-ca22c5bcf212 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:31.420713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1196/2381] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:31.425569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbc5b3-e7a6-4513-863c-ffe830893543 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:31.438678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbc5b3-e7a6-4513-863c-ffe830893543 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:31.444377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75a41-9c42-4da6-9818-5dcf7ad6d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:31.445141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75a41-9c42-4da6-9818-5dcf7ad6d775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.445430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75a41-9c42-4da6-9818-5dcf7ad6d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.445742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75a41-9c42-4da6-9818-5dcf7ad6d775 admin admin] PATH_INFO: `/v3/projects/eea2dad69e194b0b9d3110187cfa0fba/users/7ac3ebfd1c474fb28c4b829c68325b3f/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.463460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75a41-9c42-4da6-9818-5dcf7ad6d775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea2dad69e194b0b9d3110187cfa0fba, user_id=7ac3ebfd1c474fb28c4b829c68325b3f, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:31.467121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75a41-9c42-4da6-9818-5dcf7ad6d775 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:31.482165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1186/2382] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:31 2022] PUT /identity/v3/projects/eea2dad69e194b0b9d3110187cfa0fba/users/7ac3ebfd1c474fb28c4b829c68325b3f/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:31.486697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04ee9e-03fb-4f7a-90b9-ca22c5bcf212 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:31.498600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04ee9e-03fb-4f7a-90b9-ca22c5bcf212 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:31.562143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be825952-c4f9-4e2b-a488-ce86c1891d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:31.562764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825952-c4f9-4e2b-a488-ce86c1891d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.563042 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825952-c4f9-4e2b-a488-ce86c1891d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.563317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825952-c4f9-4e2b-a488-ce86c1891d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.563961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be825952-c4f9-4e2b-a488-ce86c1891d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:31.565618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be825952-c4f9-4e2b-a488-ce86c1891d45 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:31.577082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1197/2383] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:31.581416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75a41-9c42-4da6-9818-5dcf7ad6d775 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:31.593662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75a41-9c42-4da6-9818-5dcf7ad6d775 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:31.598913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:31.599574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.599908 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.600126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] PATH_INFO: `/v3/projects/eea2dad69e194b0b9d3110187cfa0fba/users/7ac3ebfd1c474fb28c4b829c68325b3f/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.602095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea2dad69e194b0b9d3110187cfa0fba, user_id=7ac3ebfd1c474fb28c4b829c68325b3f, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:31.607893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:31.625002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1187/2384] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:31 2022] PUT /identity/v3/projects/eea2dad69e194b0b9d3110187cfa0fba/users/7ac3ebfd1c474fb28c4b829c68325b3f/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:31.639495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9c4f5-bb90-4363-8d43-4a7aa23b55ef None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.639785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9c4f5-bb90-4363-8d43-4a7aa23b55ef None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.640083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9c4f5-bb90-4363-8d43-4a7aa23b55ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.662374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:31.675174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f3a9c4f5-bb90-4363-8d43-4a7aa23b55ef None None] MFA Rules not processed for user `7ac3ebfd1c474fb28c4b829c68325b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:31.676456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f3a9c4f5-bb90-4363-8d43-4a7aa23b55ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:31.755354 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1198/2385] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:31.767253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:31.769263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:31.832128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8f10-25ef-4bd6-ac30-b32a0c472166 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:31.836363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db66b16-f08b-4b67-b3a5-e765f34867da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:31.837014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db66b16-f08b-4b67-b3a5-e765f34867da service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:31.837359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db66b16-f08b-4b67-b3a5-e765f34867da service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:31.837571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db66b16-f08b-4b67-b3a5-e765f34867da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:31.848597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db66b16-f08b-4b67-b3a5-e765f34867da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:31.850129 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db66b16-f08b-4b67-b3a5-e765f34867da service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:31.860784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1188/2386] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:32.006679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9c4f5-bb90-4363-8d43-4a7aa23b55ef None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:32.075607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9c4f5-bb90-4363-8d43-4a7aa23b55ef None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:32.080876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:32.081522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:32.081817 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:32.082069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] PATH_INFO: `/v3/users/b37cc462da4f4c23b2e666f425c83d32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:32.083219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37cc462da4f4c23b2e666f425c83d32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:32.085206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:32.143753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37cc462da4f4c23b2e666f425c83d32'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.158415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37cc462da4f4c23b2e666f425c83d32'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.170000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37cc462da4f4c23b2e666f425c83d32'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.170798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37cc462da4f4c23b2e666f425c83d32'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.171448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37cc462da4f4c23b2e666f425c83d32'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.184682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1199/2387] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:32 2022] DELETE /identity/v3/users/b37cc462da4f4c23b2e666f425c83d32 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:32.189059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ffdd8-5be5-4e4a-8642-f13e47b1bd31 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:32.189429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ffdd8-5be5-4e4a-8642-f13e47b1bd31 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:32.189881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ffdd8-5be5-4e4a-8642-f13e47b1bd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:32.211576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d82ffdd8-5be5-4e4a-8642-f13e47b1bd31 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:32.212924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d82ffdd8-5be5-4e4a-8642-f13e47b1bd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:32.281374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1189/2388] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:32.293297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:32.295269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:32.314840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:32.363638 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008810bc-b18b-472a-a459-47c85fb7dc62 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:32.368416 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7a008-92b0-48bc-9582-5c8e6b9599b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:32.369149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7a008-92b0-48bc-9582-5c8e6b9599b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:32.369466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7a008-92b0-48bc-9582-5c8e6b9599b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:32.369788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7a008-92b0-48bc-9582-5c8e6b9599b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:32.381375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7a008-92b0-48bc-9582-5c8e6b9599b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:32.382816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7a008-92b0-48bc-9582-5c8e6b9599b9 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:32.395368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1200/2389] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:32.702803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ffdd8-5be5-4e4a-8642-f13e47b1bd31 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:32.704725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d82ffdd8-5be5-4e4a-8642-f13e47b1bd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:32.719383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ffdd8-5be5-4e4a-8642-f13e47b1bd31 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:32.725016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:32.725705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:32.725985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:32.726380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] PATH_INFO: `/v3/projects/1883bdd6bd3f49ee9da4fc2c1e567a88` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:32.727551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1883bdd6bd3f49ee9da4fc2c1e567a88)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:32.729662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:32.782391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1883bdd6bd3f49ee9da4fc2c1e567a88', 'request_id': 'req-4b99d07d-c462-4371-8bba-45c469f6b561'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.784360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:32.792454 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1883bdd6bd3f49ee9da4fc2c1e567a88', 'request_id': 'req-4b99d07d-c462-4371-8bba-45c469f6b561'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.803255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1883bdd6bd3f49ee9da4fc2c1e567a88', 'request_id': 'req-4b99d07d-c462-4371-8bba-45c469f6b561'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.814896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] The token cache is being invalidate because project 1883bdd6bd3f49ee9da4fc2c1e567a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:32.815204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.815835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b99d07d-c462-4371-8bba-45c469f6b561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.817397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1190/2390] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:32 2022] DELETE /identity/v3/projects/1883bdd6bd3f49ee9da4fc2c1e567a88 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:32.822606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7a008-92b0-48bc-9582-5c8e6b9599b9 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:32.834987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7a008-92b0-48bc-9582-5c8e6b9599b9 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:32.898992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:32.899658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:32.899968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:32.900238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] PATH_INFO: `/v3/users/7ac3ebfd1c474fb28c4b829c68325b3f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:32.901532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac3ebfd1c474fb28c4b829c68325b3f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:32.904467 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:32.969073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac3ebfd1c474fb28c4b829c68325b3f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.982243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac3ebfd1c474fb28c4b829c68325b3f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.991754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac3ebfd1c474fb28c4b829c68325b3f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.992656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac3ebfd1c474fb28c4b829c68325b3f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:32.993372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac3ebfd1c474fb28c4b829c68325b3f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:33.008242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1201/2391] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:32 2022] DELETE /identity/v3/users/7ac3ebfd1c474fb28c4b829c68325b3f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:33.069872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e344ba-687f-4454-9cbd-13c6714e2cec None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:33.070389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e344ba-687f-4454-9cbd-13c6714e2cec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:33.070522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e344ba-687f-4454-9cbd-13c6714e2cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:33.105694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-19e344ba-687f-4454-9cbd-13c6714e2cec None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:33.107193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-19e344ba-687f-4454-9cbd-13c6714e2cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:33.193782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1191/2392] 10.222.0.55 () {58 vars in 967 bytes} [Tue Sep 13 12:38:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:33.207378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:33.208843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:33.267883 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:33.299040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7f638-8a22-446d-a40e-70ae6e16d459 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:33.306058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7851e9-9572-449d-b5ec-5938e856cd3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:33.306690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7851e9-9572-449d-b5ec-5938e856cd3f service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:33.306963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7851e9-9572-449d-b5ec-5938e856cd3f service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:33.307233 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7851e9-9572-449d-b5ec-5938e856cd3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:33.318718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7851e9-9572-449d-b5ec-5938e856cd3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:33.320870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7851e9-9572-449d-b5ec-5938e856cd3f service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:33.331709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1202/2393] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:38:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:38:33.442183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e344ba-687f-4454-9cbd-13c6714e2cec None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:33.444078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-19e344ba-687f-4454-9cbd-13c6714e2cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:33.541538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e344ba-687f-4454-9cbd-13c6714e2cec None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:33.547084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:33.547984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:33.548267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:33.548580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] PATH_INFO: `/v3/projects/eea2dad69e194b0b9d3110187cfa0fba` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:33.549755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea2dad69e194b0b9d3110187cfa0fba)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:33.552003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:33.617392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea2dad69e194b0b9d3110187cfa0fba', 'request_id': 'req-cead89ad-6b2b-4885-be6e-638f4029516a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:33.624061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea2dad69e194b0b9d3110187cfa0fba', 'request_id': 'req-cead89ad-6b2b-4885-be6e-638f4029516a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:33.633456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea2dad69e194b0b9d3110187cfa0fba', 'request_id': 'req-cead89ad-6b2b-4885-be6e-638f4029516a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:33.646262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] The token cache is being invalidate because project eea2dad69e194b0b9d3110187cfa0fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:33.646554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:33.647241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cead89ad-6b2b-4885-be6e-638f4029516a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:33.648965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1192/2394] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:33 2022] DELETE /identity/v3/projects/eea2dad69e194b0b9d3110187cfa0fba => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:33.654270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51eed0-f005-4272-9fdc-bc19808e26c3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:33.654633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51eed0-f005-4272-9fdc-bc19808e26c3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:33.654899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51eed0-f005-4272-9fdc-bc19808e26c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:33.676845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6f51eed0-f005-4272-9fdc-bc19808e26c3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:33.678417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6f51eed0-f005-4272-9fdc-bc19808e26c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:33.741150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1203/2395] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:33.750994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6d30f-653f-4a9a-9cbc-970d81f37e30 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:33.751283 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6d30f-653f-4a9a-9cbc-970d81f37e30 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:33.751561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6d30f-653f-4a9a-9cbc-970d81f37e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:33.766678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:33.772943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1ec6d30f-653f-4a9a-9cbc-970d81f37e30 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:33.775056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1ec6d30f-653f-4a9a-9cbc-970d81f37e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:33.783843 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1193/2396] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:33.788247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51eed0-f005-4272-9fdc-bc19808e26c3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:33.799040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51eed0-f005-4272-9fdc-bc19808e26c3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:33.805020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:33.805717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:33.805985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:33.806255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:33.807050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:38:33.807357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:33.809021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:33.822475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1204/2397] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:38:33.827887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6d30f-653f-4a9a-9cbc-970d81f37e30 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:33.838444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6d30f-653f-4a9a-9cbc-970d81f37e30 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:33.843901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd8e1e-60ed-4b1f-9524-cbf04305a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:33.844535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd8e1e-60ed-4b1f-9524-cbf04305a13d admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:33.844813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd8e1e-60ed-4b1f-9524-cbf04305a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:33.845080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd8e1e-60ed-4b1f-9524-cbf04305a13d admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:33.845721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd8e1e-60ed-4b1f-9524-cbf04305a13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:33.847632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd8e1e-60ed-4b1f-9524-cbf04305a13d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:33.878494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1194/2398] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:33 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:33.883830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:33.895248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6fc6d-b0cc-4f67-9af4-5c2367faef5a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:33.960037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4f892-10dc-4294-a551-22982adffa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:33.960672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4f892-10dc-4294-a551-22982adffa71 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:33.960995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4f892-10dc-4294-a551-22982adffa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:33.961268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4f892-10dc-4294-a551-22982adffa71 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:33.961904 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4f892-10dc-4294-a551-22982adffa71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:33.963842 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4f892-10dc-4294-a551-22982adffa71 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:33.987885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1205/2399] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:33 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:33.992313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd8e1e-60ed-4b1f-9524-cbf04305a13d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.003962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd8e1e-60ed-4b1f-9524-cbf04305a13d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.009140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5203e29-67e8-49d2-b402-9aa85afa413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.009750 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5203e29-67e8-49d2-b402-9aa85afa413e admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.010045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5203e29-67e8-49d2-b402-9aa85afa413e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.010300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5203e29-67e8-49d2-b402-9aa85afa413e admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.010982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5203e29-67e8-49d2-b402-9aa85afa413e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.013494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5203e29-67e8-49d2-b402-9aa85afa413e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.026192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1195/2400] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:34.031924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4f892-10dc-4294-a551-22982adffa71 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.045679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4f892-10dc-4294-a551-22982adffa71 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.050566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549dc9-c3ee-4f29-8e3b-a919b6fe67b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.051176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549dc9-c3ee-4f29-8e3b-a919b6fe67b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.051455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549dc9-c3ee-4f29-8e3b-a919b6fe67b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.051726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549dc9-c3ee-4f29-8e3b-a919b6fe67b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.052375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549dc9-c3ee-4f29-8e3b-a919b6fe67b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.054052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549dc9-c3ee-4f29-8e3b-a919b6fe67b5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.065700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1206/2401] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:38:34.069931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5203e29-67e8-49d2-b402-9aa85afa413e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.080189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5203e29-67e8-49d2-b402-9aa85afa413e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.085457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a212-276f-492b-915b-c280a75ff7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.086114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a212-276f-492b-915b-c280a75ff7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.086397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a212-276f-492b-915b-c280a75ff7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.086676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a212-276f-492b-915b-c280a75ff7c9 admin admin] PATH_INFO: `/v3/projects/5c5638ede92148a8b5d06ed38b6065e5/users/25b3ebeb04ac40329e3e2a238101431e/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.103625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a212-276f-492b-915b-c280a75ff7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5638ede92148a8b5d06ed38b6065e5, user_id=25b3ebeb04ac40329e3e2a238101431e, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.106402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a212-276f-492b-915b-c280a75ff7c9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.124029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1196/2402] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:34 2022] PUT /identity/v3/projects/5c5638ede92148a8b5d06ed38b6065e5/users/25b3ebeb04ac40329e3e2a238101431e/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:34.134756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3903e-73e2-4f79-9cfe-9b01e446a2e8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.135040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3903e-73e2-4f79-9cfe-9b01e446a2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.135331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3903e-73e2-4f79-9cfe-9b01e446a2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.165335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e5f3903e-73e2-4f79-9cfe-9b01e446a2e8 None None] MFA Rules not processed for user `25b3ebeb04ac40329e3e2a238101431e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:34.166529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e5f3903e-73e2-4f79-9cfe-9b01e446a2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:34.191539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:34.256820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1207/2403] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:34.258200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a212-276f-492b-915b-c280a75ff7c9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.329903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a212-276f-492b-915b-c280a75ff7c9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.335516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49188c0-eb33-4292-a94f-94753d7e9209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.336222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49188c0-eb33-4292-a94f-94753d7e9209 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.336573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49188c0-eb33-4292-a94f-94753d7e9209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.336852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49188c0-eb33-4292-a94f-94753d7e9209 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.337501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49188c0-eb33-4292-a94f-94753d7e9209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.339457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49188c0-eb33-4292-a94f-94753d7e9209 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.376479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1197/2404] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:34 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:34.379826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3903e-73e2-4f79-9cfe-9b01e446a2e8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.391400 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3903e-73e2-4f79-9cfe-9b01e446a2e8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.451148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52d7a-2279-457b-a96c-3765eb2ea34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.451756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52d7a-2279-457b-a96c-3765eb2ea34e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.452034 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52d7a-2279-457b-a96c-3765eb2ea34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.452308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52d7a-2279-457b-a96c-3765eb2ea34e admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.452972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba52d7a-2279-457b-a96c-3765eb2ea34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.454921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba52d7a-2279-457b-a96c-3765eb2ea34e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.480987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1208/2405] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:34 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:34.485116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49188c0-eb33-4292-a94f-94753d7e9209 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.495692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49188c0-eb33-4292-a94f-94753d7e9209 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.501619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1b79b-19d9-46fc-b940-424eb68acb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.502232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1b79b-19d9-46fc-b940-424eb68acb20 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.502508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1b79b-19d9-46fc-b940-424eb68acb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.502783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1b79b-19d9-46fc-b940-424eb68acb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.503415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1b79b-19d9-46fc-b940-424eb68acb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.505085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1b79b-19d9-46fc-b940-424eb68acb20 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.517444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1198/2406] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:34.522000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52d7a-2279-457b-a96c-3765eb2ea34e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.533651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52d7a-2279-457b-a96c-3765eb2ea34e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.538956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8197b-8335-432a-8658-eb3eda33e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.539653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8197b-8335-432a-8658-eb3eda33e91d admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.539933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8197b-8335-432a-8658-eb3eda33e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.540202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8197b-8335-432a-8658-eb3eda33e91d admin admin] PATH_INFO: `/v3/projects/01643738e61b44c0b01408e9525dfb3c/users/2514a8be38f042f496a5407cd25c3471/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.556956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8197b-8335-432a-8658-eb3eda33e91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01643738e61b44c0b01408e9525dfb3c, user_id=2514a8be38f042f496a5407cd25c3471, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.559696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8197b-8335-432a-8658-eb3eda33e91d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.575004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1209/2407] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:34 2022] PUT /identity/v3/projects/01643738e61b44c0b01408e9525dfb3c/users/2514a8be38f042f496a5407cd25c3471/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:34.579557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1b79b-19d9-46fc-b940-424eb68acb20 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.592943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1b79b-19d9-46fc-b940-424eb68acb20 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.653690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e93cb-3838-46b5-a75a-5994075f8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.654444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e93cb-3838-46b5-a75a-5994075f8b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.654719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e93cb-3838-46b5-a75a-5994075f8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.654988 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e93cb-3838-46b5-a75a-5994075f8b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.655632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e93cb-3838-46b5-a75a-5994075f8b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.657266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e93cb-3838-46b5-a75a-5994075f8b03 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.666968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1199/2408] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:38:34.671518 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8197b-8335-432a-8658-eb3eda33e91d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.682070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8197b-8335-432a-8658-eb3eda33e91d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.687873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.688571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.688843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.689108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] PATH_INFO: `/v3/projects/01643738e61b44c0b01408e9525dfb3c/users/2514a8be38f042f496a5407cd25c3471/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.691336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01643738e61b44c0b01408e9525dfb3c, user_id=2514a8be38f042f496a5407cd25c3471, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.694176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.705989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1210/2409] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:34 2022] PUT /identity/v3/projects/01643738e61b44c0b01408e9525dfb3c/users/2514a8be38f042f496a5407cd25c3471/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:34.717632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9c83c-19a4-4de8-a404-0c7e81cee30e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.717931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9c83c-19a4-4de8-a404-0c7e81cee30e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.718213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9c83c-19a4-4de8-a404-0c7e81cee30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.747862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:34.752600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-03e9c83c-19a4-4de8-a404-0c7e81cee30e None None] MFA Rules not processed for user `2514a8be38f042f496a5407cd25c3471`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:34.753511 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-03e9c83c-19a4-4de8-a404-0c7e81cee30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:34.828947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1200/2410] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:34.840078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:34.842090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:34.906614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352269-7126-45c4-8056-7b613199cd2c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:34.910439 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944429a0-e753-494c-8e8b-521fd5f4c200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:34.911058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944429a0-e753-494c-8e8b-521fd5f4c200 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:34.911314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944429a0-e753-494c-8e8b-521fd5f4c200 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:34.911587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944429a0-e753-494c-8e8b-521fd5f4c200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:34.950132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:34.983978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944429a0-e753-494c-8e8b-521fd5f4c200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:34.985470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944429a0-e753-494c-8e8b-521fd5f4c200 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:34.994447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1211/2411] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:39.393564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9c83c-19a4-4de8-a404-0c7e81cee30e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:39.395559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-03e9c83c-19a4-4de8-a404-0c7e81cee30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:39.411157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9c83c-19a4-4de8-a404-0c7e81cee30e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:39.416944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007c5c3-3807-4b26-90d5-8b7c667c704f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:39.417767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007c5c3-3807-4b26-90d5-8b7c667c704f service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:39.418103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007c5c3-3807-4b26-90d5-8b7c667c704f service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:39.418477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007c5c3-3807-4b26-90d5-8b7c667c704f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:39.431152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007c5c3-3807-4b26-90d5-8b7c667c704f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:39.432625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007c5c3-3807-4b26-90d5-8b7c667c704f service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:39.442652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1201/2412] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:44.457428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944429a0-e753-494c-8e8b-521fd5f4c200 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:44.532001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944429a0-e753-494c-8e8b-521fd5f4c200 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:44.537345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:44.538718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:44.538999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:44.539437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] PATH_INFO: `/v3/users/25b3ebeb04ac40329e3e2a238101431e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:44.540879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b3ebeb04ac40329e3e2a238101431e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:44.542890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:44.612022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b3ebeb04ac40329e3e2a238101431e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:44.627871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b3ebeb04ac40329e3e2a238101431e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:44.638923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b3ebeb04ac40329e3e2a238101431e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:44.639895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b3ebeb04ac40329e3e2a238101431e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:44.640790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b3ebeb04ac40329e3e2a238101431e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:44.658922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1212/2413] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:44 2022] DELETE /identity/v3/users/25b3ebeb04ac40329e3e2a238101431e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:44.663854 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4288-307b-4f9e-af99-1000091fad61 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:44.664423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4288-307b-4f9e-af99-1000091fad61 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:44.664423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4288-307b-4f9e-af99-1000091fad61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:44.689619 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-777c4288-307b-4f9e-af99-1000091fad61 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:44.691716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-777c4288-307b-4f9e-af99-1000091fad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:44.779459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1202/2414] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:44.788983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:44.791063 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:44.863508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:44.871710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a393d-8c28-4bd5-b02a-a577fb48f61a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:44.879089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5521e-98bb-400b-90fe-5762c2760b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:44.879783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5521e-98bb-400b-90fe-5762c2760b53 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:44.880149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5521e-98bb-400b-90fe-5762c2760b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:44.880494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5521e-98bb-400b-90fe-5762c2760b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:44.891920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5521e-98bb-400b-90fe-5762c2760b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:44.893525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5521e-98bb-400b-90fe-5762c2760b53 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:44.905546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1213/2415] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:45.260805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4288-307b-4f9e-af99-1000091fad61 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:45.263366 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-777c4288-307b-4f9e-af99-1000091fad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:45.277749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4288-307b-4f9e-af99-1000091fad61 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:45.283505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:45.284172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:45.284480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:45.284909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] PATH_INFO: `/v3/projects/5c5638ede92148a8b5d06ed38b6065e5` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:45.286014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5638ede92148a8b5d06ed38b6065e5)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:45.288183 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:45.346002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5638ede92148a8b5d06ed38b6065e5', 'request_id': 'req-498cb0a8-a228-4807-8206-7cc28ec9247c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.353021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5638ede92148a8b5d06ed38b6065e5', 'request_id': 'req-498cb0a8-a228-4807-8206-7cc28ec9247c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.362684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5638ede92148a8b5d06ed38b6065e5', 'request_id': 'req-498cb0a8-a228-4807-8206-7cc28ec9247c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.378093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] The token cache is being invalidate because project 5c5638ede92148a8b5d06ed38b6065e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:45.378652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.379482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.381215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1203/2416] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:45 2022] DELETE /identity/v3/projects/5c5638ede92148a8b5d06ed38b6065e5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:45.386681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5521e-98bb-400b-90fe-5762c2760b53 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:45.401623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5521e-98bb-400b-90fe-5762c2760b53 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:45.480129 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:45.480864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:45.481074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:45.481342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] PATH_INFO: `/v3/users/2514a8be38f042f496a5407cd25c3471` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:45.482504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2514a8be38f042f496a5407cd25c3471)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:45.484454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:45.570422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2514a8be38f042f496a5407cd25c3471'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.590615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2514a8be38f042f496a5407cd25c3471'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.599989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2514a8be38f042f496a5407cd25c3471'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.600781 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2514a8be38f042f496a5407cd25c3471'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.601479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1227917-f290-48aa-a3dd-1baf0ce8e26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2514a8be38f042f496a5407cd25c3471'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:45.617116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1214/2417] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:45 2022] DELETE /identity/v3/users/2514a8be38f042f496a5407cd25c3471 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:45.918682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:45.920820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:45.948402 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb0a8-a228-4807-8206-7cc28ec9247c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:45.954327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:46.014561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:46.015203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.015550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.015859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] PATH_INFO: `/v3/projects/01643738e61b44c0b01408e9525dfb3c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.017361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01643738e61b44c0b01408e9525dfb3c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:46.019484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:46.072813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01643738e61b44c0b01408e9525dfb3c', 'request_id': 'req-88cc8b4f-9218-4104-b06e-bb1fb84ef746'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:46.080016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01643738e61b44c0b01408e9525dfb3c', 'request_id': 'req-88cc8b4f-9218-4104-b06e-bb1fb84ef746'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:46.089488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01643738e61b44c0b01408e9525dfb3c', 'request_id': 'req-88cc8b4f-9218-4104-b06e-bb1fb84ef746'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:46.101542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] The token cache is being invalidate because project 01643738e61b44c0b01408e9525dfb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:46.101838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:46.102505 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-88cc8b4f-9218-4104-b06e-bb1fb84ef746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:46.104065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1204/2418] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:45 2022] DELETE /identity/v3/projects/01643738e61b44c0b01408e9525dfb3c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:46.110429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62a36-61cb-4dff-b6f6-2c1508870db9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.110735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62a36-61cb-4dff-b6f6-2c1508870db9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.111006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62a36-61cb-4dff-b6f6-2c1508870db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.131975 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-73d62a36-61cb-4dff-b6f6-2c1508870db9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:46.133246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-73d62a36-61cb-4dff-b6f6-2c1508870db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:46.213515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1215/2419] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:38:46.222420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7741260-b160-4c2f-a344-949676a4932e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.222710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7741260-b160-4c2f-a344-949676a4932e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.222990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7741260-b160-4c2f-a344-949676a4932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.251920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c7741260-b160-4c2f-a344-949676a4932e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:46.253215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c7741260-b160-4c2f-a344-949676a4932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:46.267947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1205/2420] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:46.271720 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62a36-61cb-4dff-b6f6-2c1508870db9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:46.289954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62a36-61cb-4dff-b6f6-2c1508870db9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:46.289954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:46.289954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.289954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.290331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.290907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:38:46.291277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:46.293045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:46.295733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:46.314081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1216/2421] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:38:46.316445 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7741260-b160-4c2f-a344-949676a4932e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:46.326859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7741260-b160-4c2f-a344-949676a4932e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:46.338024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebb407-451b-4325-b156-04208f0503f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:46.338795 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb407-451b-4325-b156-04208f0503f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.339152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb407-451b-4325-b156-04208f0503f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.339431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb407-451b-4325-b156-04208f0503f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.340090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebb407-451b-4325-b156-04208f0503f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:46.342061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebb407-451b-4325-b156-04208f0503f5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:46.378439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1206/2422] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:46 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:46.379595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:46.391102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e2d78-831e-48f5-93f3-b11ed3a93302 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:46.482234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e0ed1-6bcc-4118-bb25-aab6f072ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:46.483159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e0ed1-6bcc-4118-bb25-aab6f072ec7b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.483159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e0ed1-6bcc-4118-bb25-aab6f072ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.483514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e0ed1-6bcc-4118-bb25-aab6f072ec7b admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.484121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e0ed1-6bcc-4118-bb25-aab6f072ec7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:46.486177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e0ed1-6bcc-4118-bb25-aab6f072ec7b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:46.521836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1217/2423] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:46 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:46.523107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebb407-451b-4325-b156-04208f0503f5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:46.538427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebb407-451b-4325-b156-04208f0503f5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:46.544435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443e49f-d6c9-4278-a287-be80db7aee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:46.545199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e49f-d6c9-4278-a287-be80db7aee6a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.546536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e49f-d6c9-4278-a287-be80db7aee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.547063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e49f-d6c9-4278-a287-be80db7aee6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.548633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443e49f-d6c9-4278-a287-be80db7aee6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:46.551444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443e49f-d6c9-4278-a287-be80db7aee6a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:46.567636 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1207/2424] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:38:46.572932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e0ed1-6bcc-4118-bb25-aab6f072ec7b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:46.588549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e0ed1-6bcc-4118-bb25-aab6f072ec7b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:46.594314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfb2ed-91b0-4187-ad0e-de33e3f8d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:46.594940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfb2ed-91b0-4187-ad0e-de33e3f8d1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.595228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfb2ed-91b0-4187-ad0e-de33e3f8d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.595495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfb2ed-91b0-4187-ad0e-de33e3f8d1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.596303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfb2ed-91b0-4187-ad0e-de33e3f8d1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:46.597940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfb2ed-91b0-4187-ad0e-de33e3f8d1f8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:46.616032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1218/2425] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:46.621205 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443e49f-d6c9-4278-a287-be80db7aee6a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:46.635271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443e49f-d6c9-4278-a287-be80db7aee6a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:46.642570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:46.643655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.644186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.644773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] PATH_INFO: `/v3/projects/aec1b0e279dc44cd846475bd26962797/users/64eb3de4a29a436d8aba9180702c79d4/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.666405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec1b0e279dc44cd846475bd26962797, user_id=64eb3de4a29a436d8aba9180702c79d4, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:46.671091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:46.690069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1208/2426] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:46 2022] PUT /identity/v3/projects/aec1b0e279dc44cd846475bd26962797/users/64eb3de4a29a436d8aba9180702c79d4/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:38:46.706292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2b58-f573-4429-8ec5-2677d5af5ad0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.706546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2b58-f573-4429-8ec5-2677d5af5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.706809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2b58-f573-4429-8ec5-2677d5af5ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.742277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e18e2b58-f573-4429-8ec5-2677d5af5ad0 None None] MFA Rules not processed for user `64eb3de4a29a436d8aba9180702c79d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:46.743524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e18e2b58-f573-4429-8ec5-2677d5af5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:46.821829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1219/2427] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:46.836721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:46.838926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:46.897278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:46.922304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152256-5a94-4887-aa6c-262f738f45a7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:46.928606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812df00-d673-4240-a859-f813e362e2af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:46.929269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812df00-d673-4240-a859-f813e362e2af service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:46.929568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812df00-d673-4240-a859-f813e362e2af service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:46.929912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812df00-d673-4240-a859-f813e362e2af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:46.939373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812df00-d673-4240-a859-f813e362e2af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:46.940876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812df00-d673-4240-a859-f813e362e2af service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:46.951015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1209/2428] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:46.975584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2b58-f573-4429-8ec5-2677d5af5ad0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:47.059630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2b58-f573-4429-8ec5-2677d5af5ad0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:47.067168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:47.068768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:47.069293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:47.069728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] PATH_INFO: `/v3/users/64eb3de4a29a436d8aba9180702c79d4` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:47.071148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64eb3de4a29a436d8aba9180702c79d4)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:47.073129 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:47.079144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:47.138923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64eb3de4a29a436d8aba9180702c79d4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.153054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64eb3de4a29a436d8aba9180702c79d4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.163167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64eb3de4a29a436d8aba9180702c79d4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.164023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64eb3de4a29a436d8aba9180702c79d4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.164628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64eb3de4a29a436d8aba9180702c79d4'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.178825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1220/2429] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:46 2022] DELETE /identity/v3/users/64eb3de4a29a436d8aba9180702c79d4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:47.184192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc6d95-e706-40e0-bcb9-162614117d58 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:47.184520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc6d95-e706-40e0-bcb9-162614117d58 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:47.184802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc6d95-e706-40e0-bcb9-162614117d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:47.207311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b1fc6d95-e706-40e0-bcb9-162614117d58 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:47.208599 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b1fc6d95-e706-40e0-bcb9-162614117d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:47.284072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1210/2430] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:47.296706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:47.298856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:47.398551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb561c-8331-4010-8460-5f28fbedc2d3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:47.403580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00e29d-a6dc-45ba-b01b-be063149e6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:47.404776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00e29d-a6dc-45ba-b01b-be063149e6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:47.405089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00e29d-a6dc-45ba-b01b-be063149e6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:47.405630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00e29d-a6dc-45ba-b01b-be063149e6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:47.420522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00e29d-a6dc-45ba-b01b-be063149e6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:47.422066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00e29d-a6dc-45ba-b01b-be063149e6c1 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:47.440666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1221/2431] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:47.769644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc6d95-e706-40e0-bcb9-162614117d58 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:47.772873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b1fc6d95-e706-40e0-bcb9-162614117d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:47.799590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc6d95-e706-40e0-bcb9-162614117d58 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:47.804515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:47.805174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:47.805465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:47.805729 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] PATH_INFO: `/v3/projects/aec1b0e279dc44cd846475bd26962797` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:47.807001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec1b0e279dc44cd846475bd26962797)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:47.809225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:47.863470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec1b0e279dc44cd846475bd26962797', 'request_id': 'req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.871146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec1b0e279dc44cd846475bd26962797', 'request_id': 'req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.880478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec1b0e279dc44cd846475bd26962797', 'request_id': 'req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.893030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] The token cache is being invalidate because project aec1b0e279dc44cd846475bd26962797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:47.893322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.894023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-84bffc55-3a04-4f36-91a1-2fca5c1b6a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:47.895825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1211/2432] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:47 2022] DELETE /identity/v3/projects/aec1b0e279dc44cd846475bd26962797 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:47.900959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb113-69bc-4858-a4c2-45c0acc948a0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:47.901434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb113-69bc-4858-a4c2-45c0acc948a0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:47.901646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb113-69bc-4858-a4c2-45c0acc948a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:47.922210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8b2cb113-69bc-4858-a4c2-45c0acc948a0 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:47.923405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8b2cb113-69bc-4858-a4c2-45c0acc948a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:47.986735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1222/2433] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:47.995937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034602-daf1-4819-b714-87a3258a96b6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:47.996484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034602-daf1-4819-b714-87a3258a96b6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:47.996597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034602-daf1-4819-b714-87a3258a96b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.018330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c5034602-daf1-4819-b714-87a3258a96b6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:48.019566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c5034602-daf1-4819-b714-87a3258a96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:48.029686 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1212/2434] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:48.037152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb113-69bc-4858-a4c2-45c0acc948a0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:48.054308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb113-69bc-4858-a4c2-45c0acc948a0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:48.060168 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:48.060810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:48.061063 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:48.061327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.061973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:38:48.062273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:48.063996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:48.078442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1223/2435] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:38:48.083532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5034602-daf1-4819-b714-87a3258a96b6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:48.095960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5034602-daf1-4819-b714-87a3258a96b6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:48.103242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954d73a-2ded-4410-85a2-c5c1ae9e9e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:48.104093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954d73a-2ded-4410-85a2-c5c1ae9e9e26 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:48.104457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954d73a-2ded-4410-85a2-c5c1ae9e9e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:48.104869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954d73a-2ded-4410-85a2-c5c1ae9e9e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.105841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954d73a-2ded-4410-85a2-c5c1ae9e9e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:48.108674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954d73a-2ded-4410-85a2-c5c1ae9e9e26 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:48.147104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1213/2436] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:48 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:48.151627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:48.161695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfb5f8-ae3c-4921-ba22-45d6caef73af admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:48.171179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:48.222337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8f697-de24-4454-bc61-38e998e8dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:48.223014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8f697-de24-4454-bc61-38e998e8dfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:48.223368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8f697-de24-4454-bc61-38e998e8dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:48.223691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8f697-de24-4454-bc61-38e998e8dfa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.224448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8f697-de24-4454-bc61-38e998e8dfa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:48.226460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8f697-de24-4454-bc61-38e998e8dfa6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:48.251330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1224/2437] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:48 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:48.252924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954d73a-2ded-4410-85a2-c5c1ae9e9e26 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:48.264940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954d73a-2ded-4410-85a2-c5c1ae9e9e26 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:48.269625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b0f51-5c67-4569-8fb6-015d1d8f68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:48.270230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0f51-5c67-4569-8fb6-015d1d8f68fb admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:48.270667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0f51-5c67-4569-8fb6-015d1d8f68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:48.270942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0f51-5c67-4569-8fb6-015d1d8f68fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.271769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b0f51-5c67-4569-8fb6-015d1d8f68fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:48.275758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b0f51-5c67-4569-8fb6-015d1d8f68fb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:48.287485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1214/2438] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:48.288843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8f697-de24-4454-bc61-38e998e8dfa6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:48.299889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8f697-de24-4454-bc61-38e998e8dfa6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:48.305656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80141786-bc97-497e-9a20-3810a62b8137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:48.306274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141786-bc97-497e-9a20-3810a62b8137 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:48.306556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141786-bc97-497e-9a20-3810a62b8137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:48.306831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141786-bc97-497e-9a20-3810a62b8137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.307480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80141786-bc97-497e-9a20-3810a62b8137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:48.309238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80141786-bc97-497e-9a20-3810a62b8137 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:48.322364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1225/2439] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:48.327018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b0f51-5c67-4569-8fb6-015d1d8f68fb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:48.338929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b0f51-5c67-4569-8fb6-015d1d8f68fb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:48.344089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:48.344858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:48.345136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:48.345415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] PATH_INFO: `/v3/projects/37775fb3dc3c49daaa237a498c0fd52f/users/1d3d73b835cd440daa0c373e2863f213/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.363109 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=37775fb3dc3c49daaa237a498c0fd52f, user_id=1d3d73b835cd440daa0c373e2863f213, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:48.366054 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:48.378584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:48.385125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1215/2440] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:48 2022] PUT /identity/v3/projects/37775fb3dc3c49daaa237a498c0fd52f/users/1d3d73b835cd440daa0c373e2863f213/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:48.396497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718c59a-5836-41f0-b590-8cb04c38e60f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:48.397115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718c59a-5836-41f0-b590-8cb04c38e60f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:48.397544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718c59a-5836-41f0-b590-8cb04c38e60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.429909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2718c59a-5836-41f0-b590-8cb04c38e60f None None] MFA Rules not processed for user `1d3d73b835cd440daa0c373e2863f213`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:48.431171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2718c59a-5836-41f0-b590-8cb04c38e60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:48.507698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1226/2441] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:48.521905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:48.524491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:48.589131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c39d4-fbee-4366-8d94-f98da3b613eb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:48.593023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7ccabe29f4464bafbdd7b5aab7d775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:48.593715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:48.593999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:48.594277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:48.607450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:48.608948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:48.618443 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1216/2442] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:51.022502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718c59a-5836-41f0-b590-8cb04c38e60f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:51.024031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2718c59a-5836-41f0-b590-8cb04c38e60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:51.099850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718c59a-5836-41f0-b590-8cb04c38e60f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:51.104409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:51.105054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:51.105337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:51.105586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:51.107661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:51.152572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:51.184207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:51.185698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:51.196297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1227/2443] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:54.611432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:54.613733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:54.677371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:54.678821 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:54.696036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd071e-c9a1-434a-93fc-81ac34078ee9 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:54.704606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:54.705395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:54.705741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:54.706103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] PATH_INFO: `/v3/users/2c871cad6d394173b2b43fc89940f1ac` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:54.713476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c871cad6d394173b2b43fc89940f1ac)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:54.715762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:54.723963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec799fe-f6e5-4b6c-836c-29aeb43cbd6e service glance] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:54.729588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:54.730278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:54.730633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:54.730977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:54.734022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:54.751779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:54.757296 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:54.770752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1217/2444] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:54.794483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c871cad6d394173b2b43fc89940f1ac'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:54.808524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c871cad6d394173b2b43fc89940f1ac'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:54.819212 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c871cad6d394173b2b43fc89940f1ac'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:54.819838 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c871cad6d394173b2b43fc89940f1ac'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:54.820501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-daa25741-7f9b-492d-bd67-88bfece2388f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c871cad6d394173b2b43fc89940f1ac'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:54.834897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1228/2445] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:54 2022] DELETE /identity/v3/users/2c871cad6d394173b2b43fc89940f1ac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:55.035235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:55.052854 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed94d4-f74b-4612-ad48-df2c7344b6bb service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:55.121987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:55.122688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.123022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.123333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] PATH_INFO: `/v3/projects/7646bad963114554a255a03c0a16884a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.124584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7646bad963114554a255a03c0a16884a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:55.126627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:55.175846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:55.193401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7646bad963114554a255a03c0a16884a', 'request_id': 'req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:55.200543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7646bad963114554a255a03c0a16884a', 'request_id': 'req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:55.211924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7646bad963114554a255a03c0a16884a', 'request_id': 'req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:55.223423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] The token cache is being invalidate because project 7646bad963114554a255a03c0a16884a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:55.223716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:55.224453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5c8ab5e7-85e9-41e6-a9ae-cbb37fb4dbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:55.226071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1218/2446] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:55 2022] DELETE /identity/v3/projects/7646bad963114554a255a03c0a16884a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:55.231368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0e13-144c-4753-9b79-1504b2776720 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.231694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0e13-144c-4753-9b79-1504b2776720 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.231971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0e13-144c-4753-9b79-1504b2776720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.254647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f3af0e13-144c-4753-9b79-1504b2776720 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:55.255866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f3af0e13-144c-4753-9b79-1504b2776720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:55.327799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1229/2447] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:55.335923 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1247-8350-41b4-be24-6e10223977d2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.336213 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1247-8350-41b4-be24-6e10223977d2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.336542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb1247-8350-41b4-be24-6e10223977d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.357892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dccb1247-8350-41b4-be24-6e10223977d2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:55.359118 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dccb1247-8350-41b4-be24-6e10223977d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:55.367484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1219/2448] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:38:55.372544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af0e13-144c-4753-9b79-1504b2776720 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:55.382978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af0e13-144c-4753-9b79-1504b2776720 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:55.389732 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:55.390271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.390600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.390832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.391573 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:38:55.391774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:55.393589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:55.411609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1230/2449] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:38:55.413270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1247-8350-41b4-be24-6e10223977d2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:55.424008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb1247-8350-41b4-be24-6e10223977d2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:55.429338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d5fb-2838-4351-be4f-0f554fa9ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:55.430098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d5fb-2838-4351-be4f-0f554fa9ee65 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.430383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d5fb-2838-4351-be4f-0f554fa9ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.430712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d5fb-2838-4351-be4f-0f554fa9ee65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.431382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460d5fb-2838-4351-be4f-0f554fa9ee65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:55.433565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460d5fb-2838-4351-be4f-0f554fa9ee65 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:55.469999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1220/2450] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:55 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:55.474045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:55.488235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12669728-6509-4387-8208-be5bbe471b28 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:55.535011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:55.574624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe8acd-a987-4ac2-9522-198d47c3950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:55.575334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe8acd-a987-4ac2-9522-198d47c3950b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.575626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe8acd-a987-4ac2-9522-198d47c3950b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.575888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe8acd-a987-4ac2-9522-198d47c3950b admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.576593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe8acd-a987-4ac2-9522-198d47c3950b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:55.578601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe8acd-a987-4ac2-9522-198d47c3950b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:55.603684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1231/2451] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:55 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:55.607041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d5fb-2838-4351-be4f-0f554fa9ee65 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:55.618403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d5fb-2838-4351-be4f-0f554fa9ee65 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:55.623804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6eb91-bdca-456a-ad8b-6fa2d2afb689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:55.624457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6eb91-bdca-456a-ad8b-6fa2d2afb689 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.624736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6eb91-bdca-456a-ad8b-6fa2d2afb689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.625006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6eb91-bdca-456a-ad8b-6fa2d2afb689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.625695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6eb91-bdca-456a-ad8b-6fa2d2afb689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:55.627372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6eb91-bdca-456a-ad8b-6fa2d2afb689 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:55.640746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1221/2452] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:55.645078 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe8acd-a987-4ac2-9522-198d47c3950b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:55.656204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe8acd-a987-4ac2-9522-198d47c3950b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:55.661469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b738217-3d3d-48e8-924a-806ccc96259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:55.662073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b738217-3d3d-48e8-924a-806ccc96259f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.662344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b738217-3d3d-48e8-924a-806ccc96259f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.662698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b738217-3d3d-48e8-924a-806ccc96259f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.663436 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b738217-3d3d-48e8-924a-806ccc96259f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:55.665569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b738217-3d3d-48e8-924a-806ccc96259f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:55.678974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1232/2453] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:55.683372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6eb91-bdca-456a-ad8b-6fa2d2afb689 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:55.693476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6eb91-bdca-456a-ad8b-6fa2d2afb689 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:55.698151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70aa36-cc2c-4f0c-a13a-0eda5850348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:55.698804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70aa36-cc2c-4f0c-a13a-0eda5850348c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.699078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70aa36-cc2c-4f0c-a13a-0eda5850348c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.699353 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70aa36-cc2c-4f0c-a13a-0eda5850348c admin admin] PATH_INFO: `/v3/projects/137fa71819cf45fbbcfe32ccf170eebb/users/c44d568c132b4c889ef1915b491fc5e8/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.716948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70aa36-cc2c-4f0c-a13a-0eda5850348c admin admin] RBAC: Authorizing `identity:create_grant(project_id=137fa71819cf45fbbcfe32ccf170eebb, user_id=c44d568c132b4c889ef1915b491fc5e8, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:55.720355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70aa36-cc2c-4f0c-a13a-0eda5850348c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:55.743987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1222/2454] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:55 2022] PUT /identity/v3/projects/137fa71819cf45fbbcfe32ccf170eebb/users/c44d568c132b4c889ef1915b491fc5e8/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:55.756351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88415d9-9efc-4f70-a03d-f724350ed5f6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.756687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88415d9-9efc-4f70-a03d-f724350ed5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.757100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88415d9-9efc-4f70-a03d-f724350ed5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.790017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e88415d9-9efc-4f70-a03d-f724350ed5f6 None None] MFA Rules not processed for user `c44d568c132b4c889ef1915b491fc5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:55.791776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e88415d9-9efc-4f70-a03d-f724350ed5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:55.868242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1233/2455] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:55.873121 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70aa36-cc2c-4f0c-a13a-0eda5850348c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:55.945869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70aa36-cc2c-4f0c-a13a-0eda5850348c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:55.952093 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bfe2a-a38e-4cb2-bc47-fda7eb3d905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:55.952741 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bfe2a-a38e-4cb2-bc47-fda7eb3d905c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:55.953021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bfe2a-a38e-4cb2-bc47-fda7eb3d905c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:55.953281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bfe2a-a38e-4cb2-bc47-fda7eb3d905c admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:55.953920 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bfe2a-a38e-4cb2-bc47-fda7eb3d905c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:55.955846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bfe2a-a38e-4cb2-bc47-fda7eb3d905c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:55.990389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1223/2456] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:55 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:55.995341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88415d9-9efc-4f70-a03d-f724350ed5f6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:56.007100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88415d9-9efc-4f70-a03d-f724350ed5f6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:56.071901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefedac-bb0c-4ec6-84e1-8d8f3dbde247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:56.072563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefedac-bb0c-4ec6-84e1-8d8f3dbde247 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.072840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefedac-bb0c-4ec6-84e1-8d8f3dbde247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.073102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefedac-bb0c-4ec6-84e1-8d8f3dbde247 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.073734 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefedac-bb0c-4ec6-84e1-8d8f3dbde247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:56.076013 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefedac-bb0c-4ec6-84e1-8d8f3dbde247 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:56.102338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1234/2457] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:55 2022] POST /identity/v3/users => generated 308 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:56.107406 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bfe2a-a38e-4cb2-bc47-fda7eb3d905c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:56.118269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bfe2a-a38e-4cb2-bc47-fda7eb3d905c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:56.124316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36bcbb-453d-496f-a729-b6b636fdb5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:56.124960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36bcbb-453d-496f-a729-b6b636fdb5ed admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.125376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36bcbb-453d-496f-a729-b6b636fdb5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.125637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36bcbb-453d-496f-a729-b6b636fdb5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.126290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36bcbb-453d-496f-a729-b6b636fdb5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:56.127944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36bcbb-453d-496f-a729-b6b636fdb5ed admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:56.142362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1224/2458] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:56.147215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefedac-bb0c-4ec6-84e1-8d8f3dbde247 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:56.158525 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefedac-bb0c-4ec6-84e1-8d8f3dbde247 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:56.163474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02081869-8784-4bf4-89dc-e8c6709be600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:56.164116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081869-8784-4bf4-89dc-e8c6709be600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.164417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081869-8784-4bf4-89dc-e8c6709be600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.164698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081869-8784-4bf4-89dc-e8c6709be600 admin admin] PATH_INFO: `/v3/projects/0c4c9660261147abb469cab4ff48e012/users/cda2f09d5c214054a704bb225d172faf/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.182047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02081869-8784-4bf4-89dc-e8c6709be600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4c9660261147abb469cab4ff48e012, user_id=cda2f09d5c214054a704bb225d172faf, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:56.185085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02081869-8784-4bf4-89dc-e8c6709be600 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:56.202332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1235/2459] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:56 2022] PUT /identity/v3/projects/0c4c9660261147abb469cab4ff48e012/users/cda2f09d5c214054a704bb225d172faf/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:56.206369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36bcbb-453d-496f-a729-b6b636fdb5ed admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:56.216925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36bcbb-453d-496f-a729-b6b636fdb5ed admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:56.246905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:56.286630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c19c8-3a7f-40f1-bdd5-795bd3468077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:56.287468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c19c8-3a7f-40f1-bdd5-795bd3468077 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.287746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c19c8-3a7f-40f1-bdd5-795bd3468077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.288018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c19c8-3a7f-40f1-bdd5-795bd3468077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.288714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c19c8-3a7f-40f1-bdd5-795bd3468077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:56.290405 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c19c8-3a7f-40f1-bdd5-795bd3468077 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:56.304615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1225/2460] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:56.307490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02081869-8784-4bf4-89dc-e8c6709be600 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:56.315201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:56.319602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02081869-8784-4bf4-89dc-e8c6709be600 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:56.327319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:56.328924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.329052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.329513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] PATH_INFO: `/v3/projects/0c4c9660261147abb469cab4ff48e012/users/cda2f09d5c214054a704bb225d172faf/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.333094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4c9660261147abb469cab4ff48e012, user_id=cda2f09d5c214054a704bb225d172faf, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:56.337615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:56.349451 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1236/2461] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:56 2022] PUT /identity/v3/projects/0c4c9660261147abb469cab4ff48e012/users/cda2f09d5c214054a704bb225d172faf/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:56.363965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffeb5-6f9f-4769-b643-1553626c4e4c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.364300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffeb5-6f9f-4769-b643-1553626c4e4c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.364649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffeb5-6f9f-4769-b643-1553626c4e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.397429 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7a2ffeb5-6f9f-4769-b643-1553626c4e4c None None] MFA Rules not processed for user `cda2f09d5c214054a704bb225d172faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:56.398839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7a2ffeb5-6f9f-4769-b643-1553626c4e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:56.484965 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1226/2462] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:56.496716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:56.498812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:56.586267 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20e47e-ca41-4bed-9f48-432b738d8e24 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:56.591100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e51326-a13a-4cb4-bfd3-c2c7f64ad950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:56.591727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51326-a13a-4cb4-bfd3-c2c7f64ad950 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.592008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51326-a13a-4cb4-bfd3-c2c7f64ad950 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.592280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51326-a13a-4cb4-bfd3-c2c7f64ad950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.602661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e51326-a13a-4cb4-bfd3-c2c7f64ad950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:56.604207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e51326-a13a-4cb4-bfd3-c2c7f64ad950 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:56.614098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1237/2463] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:56 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:56.779198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ffeb5-6f9f-4769-b643-1553626c4e4c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:56.848981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ffeb5-6f9f-4769-b643-1553626c4e4c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:56.854640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:56.855319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.855600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.855845 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] PATH_INFO: `/v3/users/c44d568c132b4c889ef1915b491fc5e8` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.857180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44d568c132b4c889ef1915b491fc5e8)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:56.859140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:56.916459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44d568c132b4c889ef1915b491fc5e8'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:56.926702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44d568c132b4c889ef1915b491fc5e8'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:56.927426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44d568c132b4c889ef1915b491fc5e8'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:56.928171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44d568c132b4c889ef1915b491fc5e8'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:56.929507 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:56.937439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44d568c132b4c889ef1915b491fc5e8'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:56.963434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1227/2464] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:56 2022] DELETE /identity/v3/users/c44d568c132b4c889ef1915b491fc5e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:56.968248 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce326075-9baf-4427-bc28-d4f9bac27b5b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:56.968803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce326075-9baf-4427-bc28-d4f9bac27b5b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:56.968803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce326075-9baf-4427-bc28-d4f9bac27b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:56.993004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ce326075-9baf-4427-bc28-d4f9bac27b5b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:56.995084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ce326075-9baf-4427-bc28-d4f9bac27b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:57.062527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1238/2465] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:57.075099 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:57.076892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:57.153879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33202851-ec9d-42a1-a6b6-ddc6561d1033 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:57.158575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a19975-68cf-4215-9365-d01da54748e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:57.159220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19975-68cf-4215-9365-d01da54748e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:57.159516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19975-68cf-4215-9365-d01da54748e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:57.159808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19975-68cf-4215-9365-d01da54748e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:57.171581 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a19975-68cf-4215-9365-d01da54748e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:57.173120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a19975-68cf-4215-9365-d01da54748e6 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:57.183695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1228/2466] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:57.488282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce326075-9baf-4427-bc28-d4f9bac27b5b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:57.500309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ce326075-9baf-4427-bc28-d4f9bac27b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:57.527346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce326075-9baf-4427-bc28-d4f9bac27b5b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:57.533006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:57.533619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:57.533924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:57.534318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] PATH_INFO: `/v3/projects/137fa71819cf45fbbcfe32ccf170eebb` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:57.535596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] RBAC: Authorizing `identity:delete_project(project_id=137fa71819cf45fbbcfe32ccf170eebb)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:57.537630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:57.624636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137fa71819cf45fbbcfe32ccf170eebb', 'request_id': 'req-52f1b488-d6d0-4658-a1fe-6c9c8654354c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.637338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137fa71819cf45fbbcfe32ccf170eebb', 'request_id': 'req-52f1b488-d6d0-4658-a1fe-6c9c8654354c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.647596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137fa71819cf45fbbcfe32ccf170eebb', 'request_id': 'req-52f1b488-d6d0-4658-a1fe-6c9c8654354c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.666388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] The token cache is being invalidate because project 137fa71819cf45fbbcfe32ccf170eebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:57.666685 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.668580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.670471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1239/2467] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:57 2022] DELETE /identity/v3/projects/137fa71819cf45fbbcfe32ccf170eebb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:38:57.674529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a19975-68cf-4215-9365-d01da54748e6 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:57.692730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a19975-68cf-4215-9365-d01da54748e6 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:57.765299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:57.766034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:57.766400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:57.766689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] PATH_INFO: `/v3/users/cda2f09d5c214054a704bb225d172faf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:57.770060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda2f09d5c214054a704bb225d172faf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:57.772945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:57.827880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda2f09d5c214054a704bb225d172faf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.839253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda2f09d5c214054a704bb225d172faf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.840299 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda2f09d5c214054a704bb225d172faf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.841484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda2f09d5c214054a704bb225d172faf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.850800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2cc2fbf8-b5d2-4cc1-8982-a24488c82bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda2f09d5c214054a704bb225d172faf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:57.861980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:57.872196 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1229/2468] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:38:57 2022] DELETE /identity/v3/users/cda2f09d5c214054a704bb225d172faf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:58.213058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:58.219238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:58.245799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1b488-d6d0-4658-a1fe-6c9c8654354c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:58.263382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:58.339934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:58.340636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.340930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.341190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] PATH_INFO: `/v3/projects/0c4c9660261147abb469cab4ff48e012` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.342396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4c9660261147abb469cab4ff48e012)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:58.344378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:58.420113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4c9660261147abb469cab4ff48e012', 'request_id': 'req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:58.439072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4c9660261147abb469cab4ff48e012', 'request_id': 'req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:58.447501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4c9660261147abb469cab4ff48e012', 'request_id': 'req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:58.464470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] The token cache is being invalidate because project 0c4c9660261147abb469cab4ff48e012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:38:58.464470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:58.464470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415f04c6-bad3-4ef4-82cc-7fd312fcaf61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:38:58.468056 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1240/2469] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:38:58 2022] DELETE /identity/v3/projects/0c4c9660261147abb469cab4ff48e012 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:38:58.469607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4841317-cbf1-4add-9700-1dd63c3be9a6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.469877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4841317-cbf1-4add-9700-1dd63c3be9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.470162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4841317-cbf1-4add-9700-1dd63c3be9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.496469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c4841317-cbf1-4add-9700-1dd63c3be9a6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:58.498043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c4841317-cbf1-4add-9700-1dd63c3be9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:58.589140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1230/2470] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:58.597367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2bc4-e891-4cd5-8c0c-2a4be2b4c710 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.597681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2bc4-e891-4cd5-8c0c-2a4be2b4c710 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.598016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2bc4-e891-4cd5-8c0c-2a4be2b4c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.635264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6eff2bc4-e891-4cd5-8c0c-2a4be2b4c710 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:58.636595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6eff2bc4-e891-4cd5-8c0c-2a4be2b4c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:58.650175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1241/2471] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:58.654656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4841317-cbf1-4add-9700-1dd63c3be9a6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:58.678532 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4841317-cbf1-4add-9700-1dd63c3be9a6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:58.684592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:58.685756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.686111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.686446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.687176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:38:58.687548 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:58.689463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:58.705216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1231/2472] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:38:58.712529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2bc4-e891-4cd5-8c0c-2a4be2b4c710 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:58.714399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:58.718238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:58.722877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2bc4-e891-4cd5-8c0c-2a4be2b4c710 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:58.735323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2703e-5f1b-44f5-9c87-776c6cff4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:58.736184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2703e-5f1b-44f5-9c87-776c6cff4ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.736566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2703e-5f1b-44f5-9c87-776c6cff4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.736907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2703e-5f1b-44f5-9c87-776c6cff4ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.737761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2703e-5f1b-44f5-9c87-776c6cff4ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:58.739775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2703e-5f1b-44f5-9c87-776c6cff4ad0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:58.786729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1242/2473] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:58 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:58.787751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2703e-5f1b-44f5-9c87-776c6cff4ad0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:58.830518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4311ac-a0f9-4376-b5dd-819959ab2741 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:58.867477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2703e-5f1b-44f5-9c87-776c6cff4ad0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:58.875096 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dc780-d525-438b-91d0-d228afa72781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:58.875731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc780-d525-438b-91d0-d228afa72781 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.876016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc780-d525-438b-91d0-d228afa72781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.876291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc780-d525-438b-91d0-d228afa72781 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.877182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dc780-d525-438b-91d0-d228afa72781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:58.879430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dc780-d525-438b-91d0-d228afa72781 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:58.908695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a258089-2328-451a-8bb9-c314f125524d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:58.909326 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258089-2328-451a-8bb9-c314f125524d service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.909605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258089-2328-451a-8bb9-c314f125524d service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.909875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258089-2328-451a-8bb9-c314f125524d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.911859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8a258089-2328-451a-8bb9-c314f125524d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:58.912073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1243/2474] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:58 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:38:58.912980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dc780-d525-438b-91d0-d228afa72781 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:58.923546 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dc780-d525-438b-91d0-d228afa72781 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:58.929186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b796c5-7fd8-449c-9dcc-694f9aae25d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:58.929931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b796c5-7fd8-449c-9dcc-694f9aae25d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.930281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b796c5-7fd8-449c-9dcc-694f9aae25d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.930601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b796c5-7fd8-449c-9dcc-694f9aae25d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.931412 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b796c5-7fd8-449c-9dcc-694f9aae25d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:58.932014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:58.933273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b796c5-7fd8-449c-9dcc-694f9aae25d4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:58.935877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:58.946178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1244/2475] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:58.953218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b796c5-7fd8-449c-9dcc-694f9aae25d4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:58.966917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b796c5-7fd8-449c-9dcc-694f9aae25d4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:58.971930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9150a2-e5aa-472b-8e24-f79430fcf575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:58.972585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9150a2-e5aa-472b-8e24-f79430fcf575 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:58.972866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9150a2-e5aa-472b-8e24-f79430fcf575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:58.973191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9150a2-e5aa-472b-8e24-f79430fcf575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:58.973774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9150a2-e5aa-472b-8e24-f79430fcf575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:58.975388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9150a2-e5aa-472b-8e24-f79430fcf575 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:58.987447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1245/2476] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:58.992972 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9150a2-e5aa-472b-8e24-f79430fcf575 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:58.997148 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a258089-2328-451a-8bb9-c314f125524d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:58.998401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a258089-2328-451a-8bb9-c314f125524d service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.005532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9150a2-e5aa-472b-8e24-f79430fcf575 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:59.008609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1232/2477] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:38:59.011283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4618663-bdc5-487b-812e-2464068dd568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:59.012618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4618663-bdc5-487b-812e-2464068dd568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.013069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4618663-bdc5-487b-812e-2464068dd568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.013397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4618663-bdc5-487b-812e-2464068dd568 admin admin] PATH_INFO: `/v3/projects/19b9fde859334a039627828347916341/users/4df1e1e57097414ea1f46ddfdebc5ad9/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.043101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4618663-bdc5-487b-812e-2464068dd568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b9fde859334a039627828347916341, user_id=4df1e1e57097414ea1f46ddfdebc5ad9, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:59.048226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4618663-bdc5-487b-812e-2464068dd568 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.066654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1246/2478] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:58 2022] PUT /identity/v3/projects/19b9fde859334a039627828347916341/users/4df1e1e57097414ea1f46ddfdebc5ad9/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:59.077228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3653-6421-47ee-b59f-bebb067cd810 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.077549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3653-6421-47ee-b59f-bebb067cd810 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.080967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3653-6421-47ee-b59f-bebb067cd810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.139141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-848a3653-6421-47ee-b59f-bebb067cd810 None None] MFA Rules not processed for user `4df1e1e57097414ea1f46ddfdebc5ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:59.140414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-848a3653-6421-47ee-b59f-bebb067cd810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:59.216721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1233/2479] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:38:59.221299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4618663-bdc5-487b-812e-2464068dd568 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:59.287283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4618663-bdc5-487b-812e-2464068dd568 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:59.292285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7d2a-e0da-4fa2-92d8-bf3661a62f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:59.292969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7d2a-e0da-4fa2-92d8-bf3661a62f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.293278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7d2a-e0da-4fa2-92d8-bf3661a62f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.293548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7d2a-e0da-4fa2-92d8-bf3661a62f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.294186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f7d2a-e0da-4fa2-92d8-bf3661a62f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:59.296144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f7d2a-e0da-4fa2-92d8-bf3661a62f6d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.328878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1247/2480] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:38:59 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:38:59.333149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3653-6421-47ee-b59f-bebb067cd810 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:59.347335 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3653-6421-47ee-b59f-bebb067cd810 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:59.408268 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ca2e8-6df8-4728-9765-a8ade36e1bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:59.408994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ca2e8-6df8-4728-9765-a8ade36e1bba admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.409292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ca2e8-6df8-4728-9765-a8ade36e1bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.409638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ca2e8-6df8-4728-9765-a8ade36e1bba admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.410336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ca2e8-6df8-4728-9765-a8ade36e1bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:59.412487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ca2e8-6df8-4728-9765-a8ade36e1bba admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.440691 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1234/2481] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:38:59 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:38:59.442192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7d2a-e0da-4fa2-92d8-bf3661a62f6d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:59.453430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7d2a-e0da-4fa2-92d8-bf3661a62f6d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:59.458355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b33a2-43cd-4228-844b-36216d0dca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:59.458976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b33a2-43cd-4228-844b-36216d0dca1a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.459284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b33a2-43cd-4228-844b-36216d0dca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.459554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b33a2-43cd-4228-844b-36216d0dca1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.460218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b33a2-43cd-4228-844b-36216d0dca1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:59.466308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b33a2-43cd-4228-844b-36216d0dca1a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.478367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1248/2482] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:38:59.482567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ca2e8-6df8-4728-9765-a8ade36e1bba admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:59.493551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ca2e8-6df8-4728-9765-a8ade36e1bba admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:59.499274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6012e7-45b6-4e20-b5ed-8964161bf085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:59.499957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6012e7-45b6-4e20-b5ed-8964161bf085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.500241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6012e7-45b6-4e20-b5ed-8964161bf085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.500582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6012e7-45b6-4e20-b5ed-8964161bf085 admin admin] PATH_INFO: `/v3/projects/22452fc384514a0ebd8a9ab6b399f602/users/387c1cd79c4a4ad69fa1cda7bbd94cc9/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.517816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6012e7-45b6-4e20-b5ed-8964161bf085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22452fc384514a0ebd8a9ab6b399f602, user_id=387c1cd79c4a4ad69fa1cda7bbd94cc9, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:59.520540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6012e7-45b6-4e20-b5ed-8964161bf085 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.536113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1235/2483] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:59 2022] PUT /identity/v3/projects/22452fc384514a0ebd8a9ab6b399f602/users/387c1cd79c4a4ad69fa1cda7bbd94cc9/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:59.540306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b33a2-43cd-4228-844b-36216d0dca1a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:59.551395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b33a2-43cd-4228-844b-36216d0dca1a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:59.625407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8362c-0c3d-4b0c-b47c-e5881992183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:59.626032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8362c-0c3d-4b0c-b47c-e5881992183b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.626308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8362c-0c3d-4b0c-b47c-e5881992183b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.626582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8362c-0c3d-4b0c-b47c-e5881992183b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.627229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8362c-0c3d-4b0c-b47c-e5881992183b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:59.628971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8362c-0c3d-4b0c-b47c-e5881992183b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.643303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1249/2484] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:38:59.645210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6012e7-45b6-4e20-b5ed-8964161bf085 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:59.659665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6012e7-45b6-4e20-b5ed-8964161bf085 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:59.666417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:59.667092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.667374 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.667650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] PATH_INFO: `/v3/projects/22452fc384514a0ebd8a9ab6b399f602/users/387c1cd79c4a4ad69fa1cda7bbd94cc9/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.669782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22452fc384514a0ebd8a9ab6b399f602, user_id=387c1cd79c4a4ad69fa1cda7bbd94cc9, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:59.672452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.679021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:59.686308 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1236/2485] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:38:59 2022] PUT /identity/v3/projects/22452fc384514a0ebd8a9ab6b399f602/users/387c1cd79c4a4ad69fa1cda7bbd94cc9/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:38:59.698298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7c61a-8a1b-4f2b-bffe-e9378633f12a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.698588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7c61a-8a1b-4f2b-bffe-e9378633f12a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.698866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7c61a-8a1b-4f2b-bffe-e9378633f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.728597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-eaa7c61a-8a1b-4f2b-bffe-e9378633f12a None None] MFA Rules not processed for user `387c1cd79c4a4ad69fa1cda7bbd94cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:38:59.729828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-eaa7c61a-8a1b-4f2b-bffe-e9378633f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:59.752294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:38:59.811938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1250/2486] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:38:59.823899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:38:59.825805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:38:59.889975 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5caff-d78c-408f-a01c-dfd24c7eb08c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:38:59.894474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:38:59.895131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:38:59.895441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:38:59.895658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:38:59.906991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:38:59.908526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:38:59.918465 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1237/2487] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:38:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:00.013070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7c61a-8a1b-4f2b-bffe-e9378633f12a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:00.023866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7c61a-8a1b-4f2b-bffe-e9378633f12a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:00.028640 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c862-20a7-426c-958f-9fd5277272c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:00.029294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c862-20a7-426c-958f-9fd5277272c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:00.029574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c862-20a7-426c-958f-9fd5277272c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:00.029960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77c862-20a7-426c-958f-9fd5277272c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:00.099055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77c862-20a7-426c-958f-9fd5277272c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:00.100528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77c862-20a7-426c-958f-9fd5277272c2 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:00.109494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1251/2488] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:04.602498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:04.604122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:04.666503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c353b1-b03f-4043-8390-6b2cbb7f5f14 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:04.670450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c5027-c29e-44b6-848a-02240f9c5657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:04.671078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c5027-c29e-44b6-848a-02240f9c5657 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:04.671555 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c5027-c29e-44b6-848a-02240f9c5657 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:04.671820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c5027-c29e-44b6-848a-02240f9c5657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:04.673647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8b3c5027-c29e-44b6-848a-02240f9c5657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:04.738727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c5027-c29e-44b6-848a-02240f9c5657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:04.740210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c5027-c29e-44b6-848a-02240f9c5657 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:04.751777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1238/2489] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:06.271931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c862-20a7-426c-958f-9fd5277272c2 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:06.284152 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77c862-20a7-426c-958f-9fd5277272c2 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:06.289251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:06.290322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:06.290322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:06.290714 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] PATH_INFO: `/v3/users/4df1e1e57097414ea1f46ddfdebc5ad9` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:06.292023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df1e1e57097414ea1f46ddfdebc5ad9)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:06.294385 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:06.351522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df1e1e57097414ea1f46ddfdebc5ad9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:06.366678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df1e1e57097414ea1f46ddfdebc5ad9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:06.377808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df1e1e57097414ea1f46ddfdebc5ad9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:06.378776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df1e1e57097414ea1f46ddfdebc5ad9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:06.379837 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df1e1e57097414ea1f46ddfdebc5ad9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:06.400945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1252/2490] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:06 2022] DELETE /identity/v3/users/4df1e1e57097414ea1f46ddfdebc5ad9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:06.405833 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152a7ba-c265-4501-9abb-dec5dd87cdf2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:06.406480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152a7ba-c265-4501-9abb-dec5dd87cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:06.407070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152a7ba-c265-4501-9abb-dec5dd87cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:06.430587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c152a7ba-c265-4501-9abb-dec5dd87cdf2 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:06.432579 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c152a7ba-c265-4501-9abb-dec5dd87cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:06.494826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:06.512680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1239/2491] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:06.523254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:06.524814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:06.562914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:06.599783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b7b5e-8ca3-4f58-ad79-4dc8915c2af4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:06.604745 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7c59f-a779-4571-a0a8-0af1cb09a732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:06.605308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c59f-a779-4571-a0a8-0af1cb09a732 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:06.605585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c59f-a779-4571-a0a8-0af1cb09a732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:06.605855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c59f-a779-4571-a0a8-0af1cb09a732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:06.616123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7c59f-a779-4571-a0a8-0af1cb09a732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:06.617677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7c59f-a779-4571-a0a8-0af1cb09a732 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:06.637731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1253/2492] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:07.073942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152a7ba-c265-4501-9abb-dec5dd87cdf2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:07.075964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c152a7ba-c265-4501-9abb-dec5dd87cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:07.092013 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152a7ba-c265-4501-9abb-dec5dd87cdf2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:07.098102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:07.100281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:07.100717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:07.101106 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] PATH_INFO: `/v3/projects/19b9fde859334a039627828347916341` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:07.103237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b9fde859334a039627828347916341)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:07.105894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:07.170175 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b9fde859334a039627828347916341', 'request_id': 'req-3924d74b-028e-4577-a4fc-9714e5b705ba'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.177632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b9fde859334a039627828347916341', 'request_id': 'req-3924d74b-028e-4577-a4fc-9714e5b705ba'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.188683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b9fde859334a039627828347916341', 'request_id': 'req-3924d74b-028e-4577-a4fc-9714e5b705ba'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.210627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] The token cache is being invalidate because project 19b9fde859334a039627828347916341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:07.211018 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.211642 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.213858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1240/2493] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:07 2022] DELETE /identity/v3/projects/19b9fde859334a039627828347916341 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:07.218465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7c59f-a779-4571-a0a8-0af1cb09a732 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:07.232294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7c59f-a779-4571-a0a8-0af1cb09a732 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:07.349874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:07.351738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:07.352023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:07.352377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] PATH_INFO: `/v3/users/387c1cd79c4a4ad69fa1cda7bbd94cc9` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:07.353719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] RBAC: Authorizing `identity:delete_user(user_id=387c1cd79c4a4ad69fa1cda7bbd94cc9)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:07.355707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:07.419810 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387c1cd79c4a4ad69fa1cda7bbd94cc9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.433495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387c1cd79c4a4ad69fa1cda7bbd94cc9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.447621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387c1cd79c4a4ad69fa1cda7bbd94cc9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.449170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387c1cd79c4a4ad69fa1cda7bbd94cc9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.450119 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23e26325-11b0-4f47-b1d9-68c933a1844b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387c1cd79c4a4ad69fa1cda7bbd94cc9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.486989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1254/2494] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:07 2022] DELETE /identity/v3/users/387c1cd79c4a4ad69fa1cda7bbd94cc9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:07.838436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:07.840982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:07.860252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924d74b-028e-4577-a4fc-9714e5b705ba admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:07.936951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:07.937670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:07.937948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:07.938220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] PATH_INFO: `/v3/projects/22452fc384514a0ebd8a9ab6b399f602` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:07.939395 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22452fc384514a0ebd8a9ab6b399f602)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:07.941360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:07.993424 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22452fc384514a0ebd8a9ab6b399f602', 'request_id': 'req-9ac759f1-9530-455b-9ccb-991aeb327a85'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:07.999797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22452fc384514a0ebd8a9ab6b399f602', 'request_id': 'req-9ac759f1-9530-455b-9ccb-991aeb327a85'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.009110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22452fc384514a0ebd8a9ab6b399f602', 'request_id': 'req-9ac759f1-9530-455b-9ccb-991aeb327a85'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.021215 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] The token cache is being invalidate because project 22452fc384514a0ebd8a9ab6b399f602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:08.021515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.022285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9ac759f1-9530-455b-9ccb-991aeb327a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.023717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1241/2495] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:07 2022] DELETE /identity/v3/projects/22452fc384514a0ebd8a9ab6b399f602 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:08.028775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb4c2-3e41-40ea-a37f-70ce8374020b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.029200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb4c2-3e41-40ea-a37f-70ce8374020b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.029482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb4c2-3e41-40ea-a37f-70ce8374020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.049880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ccbdb4c2-3e41-40ea-a37f-70ce8374020b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:08.051193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ccbdb4c2-3e41-40ea-a37f-70ce8374020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:08.111100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:08.143626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1255/2496] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:08.151230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b922b7-8f05-41fe-9f1a-216d9d51db91 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.151519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b922b7-8f05-41fe-9f1a-216d9d51db91 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.151846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b922b7-8f05-41fe-9f1a-216d9d51db91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.161263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:08.173825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-11b922b7-8f05-41fe-9f1a-216d9d51db91 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:08.175757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-11b922b7-8f05-41fe-9f1a-216d9d51db91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:08.184187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1242/2497] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:08.189067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdb4c2-3e41-40ea-a37f-70ce8374020b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.199220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdb4c2-3e41-40ea-a37f-70ce8374020b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.204958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.205581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.205864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.206739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.207445 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:08.207785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.209418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.221844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1256/2498] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:08.226382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b922b7-8f05-41fe-9f1a-216d9d51db91 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.236871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b922b7-8f05-41fe-9f1a-216d9d51db91 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.241778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.242396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.242676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.242945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.243607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.245582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.286059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1243/2499] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:08 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:08.290408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.303641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a7d67-c6e6-4171-8b1f-a7a002590b6e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.358712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.360477 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:08.386610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343d7f0-f962-4ff2-8237-68a07bbb23d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.387681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d7f0-f962-4ff2-8237-68a07bbb23d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.388221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d7f0-f962-4ff2-8237-68a07bbb23d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.388666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d7f0-f962-4ff2-8237-68a07bbb23d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.389455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343d7f0-f962-4ff2-8237-68a07bbb23d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.391505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343d7f0-f962-4ff2-8237-68a07bbb23d9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.416353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1257/2500] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:08 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:08.423650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343d7f0-f962-4ff2-8237-68a07bbb23d9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.435826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343d7f0-f962-4ff2-8237-68a07bbb23d9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.442047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b0f5-d879-4994-bb62-43f97bcebf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.442676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b0f5-d879-4994-bb62-43f97bcebf38 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.442956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b0f5-d879-4994-bb62-43f97bcebf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.443229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b0f5-d879-4994-bb62-43f97bcebf38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.443909 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01b0f5-d879-4994-bb62-43f97bcebf38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.445561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01b0f5-d879-4994-bb62-43f97bcebf38 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.452655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16006-0d9b-4087-b319-945ac0227e70 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.457470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1258/2501] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:08.457598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.458066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.458398 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.458611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] PATH_INFO: `/v3/users/686c11bf06de4a0480b637d70ddc0ec2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.461355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b0f5-d879-4994-bb62-43f97bcebf38 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.470023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686c11bf06de4a0480b637d70ddc0ec2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.472538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.485219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b0f5-d879-4994-bb62-43f97bcebf38 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.493684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb624e28-9289-4916-b426-eb06d30b1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.494798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb624e28-9289-4916-b426-eb06d30b1ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.495204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb624e28-9289-4916-b426-eb06d30b1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.495583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb624e28-9289-4916-b426-eb06d30b1ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.496338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb624e28-9289-4916-b426-eb06d30b1ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.498148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb624e28-9289-4916-b426-eb06d30b1ba6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.510290 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1259/2502] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:08.515137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb624e28-9289-4916-b426-eb06d30b1ba6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.526176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb624e28-9289-4916-b426-eb06d30b1ba6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.532694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f72520-90d7-4bc7-9bf9-011321b41589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.533536 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f72520-90d7-4bc7-9bf9-011321b41589 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.533828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f72520-90d7-4bc7-9bf9-011321b41589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.534093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f72520-90d7-4bc7-9bf9-011321b41589 admin admin] PATH_INFO: `/v3/projects/d29e0857626a446f9377d83359faa6f9/users/73b59aa85cbd45e280c179029afe6cda/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.538395 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686c11bf06de4a0480b637d70ddc0ec2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.547392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686c11bf06de4a0480b637d70ddc0ec2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.548061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686c11bf06de4a0480b637d70ddc0ec2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.548733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686c11bf06de4a0480b637d70ddc0ec2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.553907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f72520-90d7-4bc7-9bf9-011321b41589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29e0857626a446f9377d83359faa6f9, user_id=73b59aa85cbd45e280c179029afe6cda, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.557062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f72520-90d7-4bc7-9bf9-011321b41589 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.560115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686c11bf06de4a0480b637d70ddc0ec2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.586319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1260/2503] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:08 2022] PUT /identity/v3/projects/d29e0857626a446f9377d83359faa6f9/users/73b59aa85cbd45e280c179029afe6cda/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:08.589567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8026cb-c82d-4394-8117-cbf85b01cb12 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.590166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8026cb-c82d-4394-8117-cbf85b01cb12 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.590638 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8026cb-c82d-4394-8117-cbf85b01cb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.600560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1244/2504] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:08 2022] DELETE /identity/v3/users/686c11bf06de4a0480b637d70ddc0ec2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:08.640696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8a8026cb-c82d-4394-8117-cbf85b01cb12 None None] MFA Rules not processed for user `73b59aa85cbd45e280c179029afe6cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:08.641931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8a8026cb-c82d-4394-8117-cbf85b01cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:08.715495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1261/2505] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:08.720089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.721604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:08.784933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8026cb-c82d-4394-8117-cbf85b01cb12 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.786483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8a8026cb-c82d-4394-8117-cbf85b01cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:08.793881 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:08.802939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8026cb-c82d-4394-8117-cbf85b01cb12 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.804645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81c411-ddfa-4e33-8c5a-171cc9a68e38 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.807973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.808743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.809014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.809300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] PATH_INFO: `/v3/projects/f8c875572a4a41fe8829be52fb8aedb1` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.810426 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c875572a4a41fe8829be52fb8aedb1)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.812792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e866-fb38-4e33-9a63-af63ac1f3b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.812928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.813516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e866-fb38-4e33-9a63-af63ac1f3b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.813901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e866-fb38-4e33-9a63-af63ac1f3b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.814009 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e866-fb38-4e33-9a63-af63ac1f3b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.814894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454e866-fb38-4e33-9a63-af63ac1f3b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.817840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454e866-fb38-4e33-9a63-af63ac1f3b95 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:08.820337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:08.851600 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1245/2506] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:08 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:08.856444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e866-fb38-4e33-9a63-af63ac1f3b95 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:08.869529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c875572a4a41fe8829be52fb8aedb1', 'request_id': 'req-29f1d838-aeab-4bba-a8a5-6918af1f363b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.883721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c875572a4a41fe8829be52fb8aedb1', 'request_id': 'req-29f1d838-aeab-4bba-a8a5-6918af1f363b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.890730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c875572a4a41fe8829be52fb8aedb1', 'request_id': 'req-29f1d838-aeab-4bba-a8a5-6918af1f363b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.903102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] The token cache is being invalidate because project f8c875572a4a41fe8829be52fb8aedb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:08.903427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.904089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-29f1d838-aeab-4bba-a8a5-6918af1f363b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:08.906020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1262/2507] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:08 2022] DELETE /identity/v3/projects/f8c875572a4a41fe8829be52fb8aedb1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:08.916993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314f8cc-607f-43b8-86a4-af137270c848 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.917268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314f8cc-607f-43b8-86a4-af137270c848 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.917661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314f8cc-607f-43b8-86a4-af137270c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.927012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e866-fb38-4e33-9a63-af63ac1f3b95 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:08.943041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c314f8cc-607f-43b8-86a4-af137270c848 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:08.944577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c314f8cc-607f-43b8-86a4-af137270c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:08.994590 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:08.995113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:08.995396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:08.995688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:08.996304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:08.998298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.017133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1263/2508] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:09.025409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1246/2509] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:08 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:09.025582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde310db-2cc9-424b-b02f-ef8fc1ad6165 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.025683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde310db-2cc9-424b-b02f-ef8fc1ad6165 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.026002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde310db-2cc9-424b-b02f-ef8fc1ad6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.026432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.028352 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:09.041918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9c976-fd5b-4702-96cd-4d6849bb5deb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.046753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936c0f1-cb70-4a7b-a171-3f6136bc77ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.047370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c0f1-cb70-4a7b-a171-3f6136bc77ac admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.047493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fde310db-2cc9-424b-b02f-ef8fc1ad6165 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:09.047641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c0f1-cb70-4a7b-a171-3f6136bc77ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.047917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c0f1-cb70-4a7b-a171-3f6136bc77ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.048606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936c0f1-cb70-4a7b-a171-3f6136bc77ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.048750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fde310db-2cc9-424b-b02f-ef8fc1ad6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:09.050234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936c0f1-cb70-4a7b-a171-3f6136bc77ac admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.056805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1264/2510] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:09.060832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1247/2511] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:09.061083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde310db-2cc9-424b-b02f-ef8fc1ad6165 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.064849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936c0f1-cb70-4a7b-a171-3f6136bc77ac admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.070860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde310db-2cc9-424b-b02f-ef8fc1ad6165 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.074484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936c0f1-cb70-4a7b-a171-3f6136bc77ac admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.076623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.077228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.077499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.077763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.078396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:09.078692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.079437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf801-4423-4b0a-9dbf-b99bf6620c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.080087 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf801-4423-4b0a-9dbf-b99bf6620c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.080295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.080417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf801-4423-4b0a-9dbf-b99bf6620c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.080680 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf801-4423-4b0a-9dbf-b99bf6620c20 admin admin] PATH_INFO: `/v3/projects/f052cab3995648b390a0e0ca8f1fc52f/users/496445e75e6e436c8046c6088934339a/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.093830 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1265/2512] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:09.098052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bf801-4423-4b0a-9dbf-b99bf6620c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f052cab3995648b390a0e0ca8f1fc52f, user_id=496445e75e6e436c8046c6088934339a, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.098306 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.100777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bf801-4423-4b0a-9dbf-b99bf6620c20 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.109154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baffd1-f64e-4e33-9ec5-ec445770187f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.114458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687d9de-65ee-4874-94c0-429e78a3bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.115092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687d9de-65ee-4874-94c0-429e78a3bfbc admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.115376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687d9de-65ee-4874-94c0-429e78a3bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.115651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687d9de-65ee-4874-94c0-429e78a3bfbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.116277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687d9de-65ee-4874-94c0-429e78a3bfbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.117141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1248/2513] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:09 2022] PUT /identity/v3/projects/f052cab3995648b390a0e0ca8f1fc52f/users/496445e75e6e436c8046c6088934339a/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:09.120997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf801-4423-4b0a-9dbf-b99bf6620c20 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.121116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687d9de-65ee-4874-94c0-429e78a3bfbc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.153818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1266/2514] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:09 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:09.158065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687d9de-65ee-4874-94c0-429e78a3bfbc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.173527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:09.193470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf801-4423-4b0a-9dbf-b99bf6620c20 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.216811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:09.228192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687d9de-65ee-4874-94c0-429e78a3bfbc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.234786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f225542-ab26-4374-a2a5-4e03fa6d8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.235398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f225542-ab26-4374-a2a5-4e03fa6d8cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.235669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f225542-ab26-4374-a2a5-4e03fa6d8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.235934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f225542-ab26-4374-a2a5-4e03fa6d8cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.236590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f225542-ab26-4374-a2a5-4e03fa6d8cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.238571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f225542-ab26-4374-a2a5-4e03fa6d8cc5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.263245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1267/2515] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:09 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:09.266959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f225542-ab26-4374-a2a5-4e03fa6d8cc5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.276717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9927a-5f9f-4be4-8fdf-2a4ae88291f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.277389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9927a-5f9f-4be4-8fdf-2a4ae88291f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.278716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9927a-5f9f-4be4-8fdf-2a4ae88291f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.278716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9927a-5f9f-4be4-8fdf-2a4ae88291f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.278716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9927a-5f9f-4be4-8fdf-2a4ae88291f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.279761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f225542-ab26-4374-a2a5-4e03fa6d8cc5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.280147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9927a-5f9f-4be4-8fdf-2a4ae88291f7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.284872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffbb41-9b72-47e8-a5fa-143ec922111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.285515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffbb41-9b72-47e8-a5fa-143ec922111d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.285914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffbb41-9b72-47e8-a5fa-143ec922111d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.286344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffbb41-9b72-47e8-a5fa-143ec922111d admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.287025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffbb41-9b72-47e8-a5fa-143ec922111d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.288669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffbb41-9b72-47e8-a5fa-143ec922111d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.292038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1249/2516] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:09.296287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9927a-5f9f-4be4-8fdf-2a4ae88291f7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.303070 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1268/2517] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:09.306813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffbb41-9b72-47e8-a5fa-143ec922111d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.309446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9927a-5f9f-4be4-8fdf-2a4ae88291f7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.315102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6f565-4211-4358-a23f-7d20928fe75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.315781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6f565-4211-4358-a23f-7d20928fe75d admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.316066 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6f565-4211-4358-a23f-7d20928fe75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.316344 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6f565-4211-4358-a23f-7d20928fe75d admin admin] PATH_INFO: `/v3/projects/f052cab3995648b390a0e0ca8f1fc52f/users/496445e75e6e436c8046c6088934339a/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.317887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffbb41-9b72-47e8-a5fa-143ec922111d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.318486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6f565-4211-4358-a23f-7d20928fe75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f052cab3995648b390a0e0ca8f1fc52f, user_id=496445e75e6e436c8046c6088934339a, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.321227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6f565-4211-4358-a23f-7d20928fe75d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.323465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff9072-3a82-4a72-bb1b-22502e1ea73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.324226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9072-3a82-4a72-bb1b-22502e1ea73e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.324555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9072-3a82-4a72-bb1b-22502e1ea73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.324832 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9072-3a82-4a72-bb1b-22502e1ea73e admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.325466 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff9072-3a82-4a72-bb1b-22502e1ea73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.327447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff9072-3a82-4a72-bb1b-22502e1ea73e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.333718 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1250/2518] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:09 2022] PUT /identity/v3/projects/f052cab3995648b390a0e0ca8f1fc52f/users/496445e75e6e436c8046c6088934339a/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:09.339669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1269/2519] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:09.344754 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6f565-4211-4358-a23f-7d20928fe75d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.346223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727747c3-8c31-403d-8b05-d3876610404d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.346504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727747c3-8c31-403d-8b05-d3876610404d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.346811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727747c3-8c31-403d-8b05-d3876610404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.376179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-727747c3-8c31-403d-8b05-d3876610404d None None] MFA Rules not processed for user `496445e75e6e436c8046c6088934339a`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:09.377419 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-727747c3-8c31-403d-8b05-d3876610404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:09.410864 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6f565-4211-4358-a23f-7d20928fe75d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.415737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ef920-ebf9-4a38-8e56-313b7b4dc68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.416427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef920-ebf9-4a38-8e56-313b7b4dc68e admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.416713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef920-ebf9-4a38-8e56-313b7b4dc68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.416993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ef920-ebf9-4a38-8e56-313b7b4dc68e admin admin] PATH_INFO: `/v3/projects/e76e96e8b8334abc9ff6795607f17656/users/950092f90f66411da24931247ee07018/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.435325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ef920-ebf9-4a38-8e56-313b7b4dc68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76e96e8b8334abc9ff6795607f17656, user_id=950092f90f66411da24931247ee07018, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.438169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ef920-ebf9-4a38-8e56-313b7b4dc68e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.451905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1270/2520] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:09.456779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1251/2521] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:09 2022] PUT /identity/v3/projects/e76e96e8b8334abc9ff6795607f17656/users/950092f90f66411da24931247ee07018/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:09.467649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727747c3-8c31-403d-8b05-d3876610404d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.469264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-727747c3-8c31-403d-8b05-d3876610404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:09.469539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674688fa-3268-4fb2-9236-5003456b311d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.469894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674688fa-3268-4fb2-9236-5003456b311d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.470240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674688fa-3268-4fb2-9236-5003456b311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.507371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-674688fa-3268-4fb2-9236-5003456b311d None None] MFA Rules not processed for user `950092f90f66411da24931247ee07018`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:09.508802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-674688fa-3268-4fb2-9236-5003456b311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:09.540672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727747c3-8c31-403d-8b05-d3876610404d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.562327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:09.597416 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1252/2522] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:09.598547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674688fa-3268-4fb2-9236-5003456b311d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.599411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.600038 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.600317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.600646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.602647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:09.618663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:09.679282 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674688fa-3268-4fb2-9236-5003456b311d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.683900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ea61-1b6a-4a66-a431-3240f186e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.684554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ea61-1b6a-4a66-a431-3240f186e86c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.684840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ea61-1b6a-4a66-a431-3240f186e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.685117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ea61-1b6a-4a66-a431-3240f186e86c admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.685752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ea61-1b6a-4a66-a431-3240f186e86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.688162 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ea61-1b6a-4a66-a431-3240f186e86c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.688677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.690571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.705208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1271/2523] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:09.721907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1253/2524] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:09 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:09.726398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.739282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15330b60-fe9a-4f5e-9816-90c32cf4b37c service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.828316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ba064-b7eb-47da-811b-f7eb719f4a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.829044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba064-b7eb-47da-811b-f7eb719f4a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.829338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba064-b7eb-47da-811b-f7eb719f4a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.829617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba064-b7eb-47da-811b-f7eb719f4a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.830314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ba064-b7eb-47da-811b-f7eb719f4a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.832329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ba064-b7eb-47da-811b-f7eb719f4a8b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.860689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1272/2525] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:09 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:09.865140 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ea61-1b6a-4a66-a431-3240f186e86c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.877761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ea61-1b6a-4a66-a431-3240f186e86c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.882771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652a393-35a7-468e-bf09-8a9c9ee82735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.883400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a393-35a7-468e-bf09-8a9c9ee82735 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.883712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a393-35a7-468e-bf09-8a9c9ee82735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.883993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a393-35a7-468e-bf09-8a9c9ee82735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.884745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652a393-35a7-468e-bf09-8a9c9ee82735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.886412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652a393-35a7-468e-bf09-8a9c9ee82735 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.900692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1254/2526] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:09.905321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ba064-b7eb-47da-811b-f7eb719f4a8b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.917744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ba064-b7eb-47da-811b-f7eb719f4a8b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:09.923405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb4ca-b261-4571-9e56-7bffb4651b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:09.924087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb4ca-b261-4571-9e56-7bffb4651b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:09.924367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb4ca-b261-4571-9e56-7bffb4651b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:09.924779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb4ca-b261-4571-9e56-7bffb4651b97 admin admin] PATH_INFO: `/v3/projects/f6231d78f6bb478ca1d71acf855680b2/users/618c376e0360466f9fe29d905c515f1b/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:09.941853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fb4ca-b261-4571-9e56-7bffb4651b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6231d78f6bb478ca1d71acf855680b2, user_id=618c376e0360466f9fe29d905c515f1b, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:09.945912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fb4ca-b261-4571-9e56-7bffb4651b97 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:09.961109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1273/2527] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:09 2022] PUT /identity/v3/projects/f6231d78f6bb478ca1d71acf855680b2/users/618c376e0360466f9fe29d905c515f1b/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:09.965668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652a393-35a7-468e-bf09-8a9c9ee82735 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:09.980753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652a393-35a7-468e-bf09-8a9c9ee82735 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:10.075798 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f72a-2cd2-4afb-9d3d-852e21f1989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:10.076460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f72a-2cd2-4afb-9d3d-852e21f1989f admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:10.076751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f72a-2cd2-4afb-9d3d-852e21f1989f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:10.077031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f72a-2cd2-4afb-9d3d-852e21f1989f admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:10.077820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f72a-2cd2-4afb-9d3d-852e21f1989f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:10.079458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f72a-2cd2-4afb-9d3d-852e21f1989f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:10.090537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1255/2528] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:10.096137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb4ca-b261-4571-9e56-7bffb4651b97 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:10.107136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb4ca-b261-4571-9e56-7bffb4651b97 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:10.113602 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a6d3-8b37-4b27-80e0-b55a996ca800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:10.114450 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a6d3-8b37-4b27-80e0-b55a996ca800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:10.114735 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a6d3-8b37-4b27-80e0-b55a996ca800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:10.115040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a6d3-8b37-4b27-80e0-b55a996ca800 admin admin] PATH_INFO: `/v3/projects/f6231d78f6bb478ca1d71acf855680b2/users/618c376e0360466f9fe29d905c515f1b/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:10.117016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a6d3-8b37-4b27-80e0-b55a996ca800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6231d78f6bb478ca1d71acf855680b2, user_id=618c376e0360466f9fe29d905c515f1b, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:10.119669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a6d3-8b37-4b27-80e0-b55a996ca800 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:10.131206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1274/2529] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:10 2022] PUT /identity/v3/projects/f6231d78f6bb478ca1d71acf855680b2/users/618c376e0360466f9fe29d905c515f1b/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:10.142311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28961-01bf-4caa-afe2-d7b4c4bc58d8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:10.142605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28961-01bf-4caa-afe2-d7b4c4bc58d8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:10.142883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28961-01bf-4caa-afe2-d7b4c4bc58d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:10.171029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-83d28961-01bf-4caa-afe2-d7b4c4bc58d8 None None] MFA Rules not processed for user `618c376e0360466f9fe29d905c515f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:10.172293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-83d28961-01bf-4caa-afe2-d7b4c4bc58d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:10.222913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:10.250391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1256/2530] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:10.262086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a6d3-8b37-4b27-80e0-b55a996ca800 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:10.336370 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a6d3-8b37-4b27-80e0-b55a996ca800 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:10.340301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:10.340943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:10.341257 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:10.341560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:10.351753 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:10.353262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:10.363313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1275/2531] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:10.493019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28961-01bf-4caa-afe2-d7b4c4bc58d8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:10.505949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28961-01bf-4caa-afe2-d7b4c4bc58d8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:10.510554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:10.511169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:10.511450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:10.512077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:10.573496 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:10.575631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:10.588801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1257/2532] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:11.133047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:11.134566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:11.147170 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57352fc6-d6f2-49df-a4ae-9e467136fc4f service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:11.151176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9528bf-f2c5-4f02-ade3-4e384bdc7013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:11.151780 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9528bf-f2c5-4f02-ade3-4e384bdc7013 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:11.152053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9528bf-f2c5-4f02-ade3-4e384bdc7013 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:11.152332 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9528bf-f2c5-4f02-ade3-4e384bdc7013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:11.161771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:11.216258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9528bf-f2c5-4f02-ade3-4e384bdc7013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:11.217746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9528bf-f2c5-4f02-ade3-4e384bdc7013 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:11.228623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1276/2533] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:13.116740 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:13.118380 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:13.190261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285fc1-6b70-45b9-a28c-4419ae7bc2f1 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:13.195520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:13.196166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:13.196536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:13.196815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] PATH_INFO: `/v3/users/1d3d73b835cd440daa0c373e2863f213` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:13.198094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3d73b835cd440daa0c373e2863f213)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:13.200115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:13.249862 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9528bf-f2c5-4f02-ade3-4e384bdc7013 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:13.255275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3d73b835cd440daa0c373e2863f213'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.261127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9528bf-f2c5-4f02-ade3-4e384bdc7013 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:13.266315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3d73b835cd440daa0c373e2863f213'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.267648 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3d73b835cd440daa0c373e2863f213'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.268357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:13.268856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3d73b835cd440daa0c373e2863f213'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.269198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:13.269472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:13.269737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] PATH_INFO: `/v3/users/950092f90f66411da24931247ee07018` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:13.270882 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950092f90f66411da24931247ee07018)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:13.272847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:13.277607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c957f215-d8ce-4bc6-accc-633565786558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3d73b835cd440daa0c373e2863f213'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.296303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:13.306899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1258/2534] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:13 2022] DELETE /identity/v3/users/1d3d73b835cd440daa0c373e2863f213 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:13.311184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3dcd0-9ac8-457b-be10-12d1da160c44 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:13.311184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3dcd0-9ac8-457b-be10-12d1da160c44 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:13.311184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3dcd0-9ac8-457b-be10-12d1da160c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:13.334626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950092f90f66411da24931247ee07018'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.342031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-38c3dcd0-9ac8-457b-be10-12d1da160c44 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:13.343958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-38c3dcd0-9ac8-457b-be10-12d1da160c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:13.352813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950092f90f66411da24931247ee07018'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.363798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950092f90f66411da24931247ee07018'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.364785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950092f90f66411da24931247ee07018'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.365829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-777a4b1d-c63e-45de-b23e-f7a0b66ddb11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950092f90f66411da24931247ee07018'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:13.383088 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1277/2535] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:13 2022] DELETE /identity/v3/users/950092f90f66411da24931247ee07018 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:13.387942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b134f-e11e-42e0-ac36-25ec737712e5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:13.388282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b134f-e11e-42e0-ac36-25ec737712e5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:13.388572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b134f-e11e-42e0-ac36-25ec737712e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:13.409031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-583b134f-e11e-42e0-ac36-25ec737712e5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:13.410402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-583b134f-e11e-42e0-ac36-25ec737712e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:13.420198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1259/2536] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:13.427927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3dcd0-9ac8-457b-be10-12d1da160c44 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:13.429234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-38c3dcd0-9ac8-457b-be10-12d1da160c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:13.475821 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1278/2537] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:13.485637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b134f-e11e-42e0-ac36-25ec737712e5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:13.491471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3dcd0-9ac8-457b-be10-12d1da160c44 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:13.505637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:13.544711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b134f-e11e-42e0-ac36-25ec737712e5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:13.548603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:13.549311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:13.549499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:13.549750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:13.550635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:13.551224 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:13.551506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:13.551779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:13.559148 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:13.560632 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:13.561325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:13.562808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:13.570432 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1279/2538] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:13.575519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1260/2539] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:13.998565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:13.998706 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.000103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.000227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.018853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f460333-cbdd-4191-a6b5-4a6b2df93c32 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.023725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329837c0-e73e-4765-a9c0-c08f7bca380e service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.026286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.027263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.027730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.028204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] PATH_INFO: `/v3/projects/37775fb3dc3c49daaa237a498c0fd52f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.029762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37775fb3dc3c49daaa237a498c0fd52f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.032727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.035606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.041497 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.042278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.043596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] PATH_INFO: `/v3/projects/e76e96e8b8334abc9ff6795607f17656` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.049251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76e96e8b8334abc9ff6795607f17656)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.051885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.128945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37775fb3dc3c49daaa237a498c0fd52f', 'request_id': 'req-39ac3873-d3c7-42f8-8494-0d2acbc453f0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.134184 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76e96e8b8334abc9ff6795607f17656', 'request_id': 'req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.137804 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:14.142798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37775fb3dc3c49daaa237a498c0fd52f', 'request_id': 'req-39ac3873-d3c7-42f8-8494-0d2acbc453f0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.149879 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37775fb3dc3c49daaa237a498c0fd52f', 'request_id': 'req-39ac3873-d3c7-42f8-8494-0d2acbc453f0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.151425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76e96e8b8334abc9ff6795607f17656', 'request_id': 'req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.162255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76e96e8b8334abc9ff6795607f17656', 'request_id': 'req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.169307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] The token cache is being invalidate because project 37775fb3dc3c49daaa237a498c0fd52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:14.169619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.170949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-39ac3873-d3c7-42f8-8494-0d2acbc453f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.176746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1280/2540] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:13 2022] DELETE /identity/v3/projects/37775fb3dc3c49daaa237a498c0fd52f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:14.178697 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4171c-409b-42c6-9176-2ffc422aff9e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.179795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4171c-409b-42c6-9176-2ffc422aff9e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.180007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4171c-409b-42c6-9176-2ffc422aff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.180921 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] The token cache is being invalidate because project e76e96e8b8334abc9ff6795607f17656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:14.181122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.181799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.183653 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1261/2541] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:13 2022] DELETE /identity/v3/projects/e76e96e8b8334abc9ff6795607f17656 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:14.187891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.191574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.210555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-32e4171c-409b-42c6-9176-2ffc422aff9e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:14.211748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-32e4171c-409b-42c6-9176-2ffc422aff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.287838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ebaa-c790-4c64-9a16-c5b374610cb9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.288696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1281/2542] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:14.293202 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.293925 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.294271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.294664 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] PATH_INFO: `/v3/users/618c376e0360466f9fe29d905c515f1b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.295961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=618c376e0360466f9fe29d905c515f1b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.296755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8672c-ac72-43d4-ab6e-bfa4f54f028c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.297244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8672c-ac72-43d4-ab6e-bfa4f54f028c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.297523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8672c-ac72-43d4-ab6e-bfa4f54f028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.298307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.320540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2eb8672c-ac72-43d4-ab6e-bfa4f54f028c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:14.321938 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2eb8672c-ac72-43d4-ab6e-bfa4f54f028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.333670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1282/2543] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:14.334796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8672c-ac72-43d4-ab6e-bfa4f54f028c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.344591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8672c-ac72-43d4-ab6e-bfa4f54f028c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.351288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.351910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.352188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.352493 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.353144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:14.353446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.355092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.359745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618c376e0360466f9fe29d905c515f1b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.367869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1283/2544] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:14.372341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.375573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618c376e0360466f9fe29d905c515f1b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.376606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618c376e0360466f9fe29d905c515f1b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.377386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618c376e0360466f9fe29d905c515f1b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.383491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6ba7c-38ae-475b-a639-06845b9ea26d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.385431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618c376e0360466f9fe29d905c515f1b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.389163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5d9a-5530-437c-906c-1a52371a202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.389811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5d9a-5530-437c-906c-1a52371a202a admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.390097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5d9a-5530-437c-906c-1a52371a202a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.390648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5d9a-5530-437c-906c-1a52371a202a admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.391208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f5d9a-5530-437c-906c-1a52371a202a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.393987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f5d9a-5530-437c-906c-1a52371a202a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.406599 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1262/2545] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:14 2022] DELETE /identity/v3/users/618c376e0360466f9fe29d905c515f1b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:14.438379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1284/2546] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:14 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:14.444743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.446392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.537949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f85997-6668-4a67-9990-d10c4fc5fc78 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.542227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:14.617818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdaa1a-c2c5-4684-8587-6337c514dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.618388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdaa1a-c2c5-4684-8587-6337c514dcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.618710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdaa1a-c2c5-4684-8587-6337c514dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.618918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdaa1a-c2c5-4684-8587-6337c514dcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.619560 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdaa1a-c2c5-4684-8587-6337c514dcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.621583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdaa1a-c2c5-4684-8587-6337c514dcc5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.647685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1263/2547] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:14 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:14.651843 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5d9a-5530-437c-906c-1a52371a202a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.657481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:14.662621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5d9a-5530-437c-906c-1a52371a202a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.668977 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.669829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.670440 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.671043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.671881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.674459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.684924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1285/2548] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:14.689194 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdaa1a-c2c5-4684-8587-6337c514dcc5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.700647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdaa1a-c2c5-4684-8587-6337c514dcc5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.706659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98478b10-01a9-4f05-92c3-f697883f67c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.707453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98478b10-01a9-4f05-92c3-f697883f67c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.707797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98478b10-01a9-4f05-92c3-f697883f67c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.708126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98478b10-01a9-4f05-92c3-f697883f67c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.709132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98478b10-01a9-4f05-92c3-f697883f67c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.711285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98478b10-01a9-4f05-92c3-f697883f67c5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.718516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.723032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.730133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1264/2549] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:14.731031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98478b10-01a9-4f05-92c3-f697883f67c5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.743214 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98478b10-01a9-4f05-92c3-f697883f67c5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.745181 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce70c7-0b51-424e-8206-2927c8c1af7b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.748190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7e3ab-d5ca-4989-a172-c9b3f7113899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.748912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7e3ab-d5ca-4989-a172-c9b3f7113899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.749265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7e3ab-d5ca-4989-a172-c9b3f7113899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.749540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7e3ab-d5ca-4989-a172-c9b3f7113899 admin admin] PATH_INFO: `/v3/projects/08ed8ebfe79141cdaa9b3444fc204d86/users/ad51b0f1c6e74d4e8dcebeb080b98451/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.754895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.755990 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.756503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.756969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] PATH_INFO: `/v3/projects/f6231d78f6bb478ca1d71acf855680b2` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.759279 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6231d78f6bb478ca1d71acf855680b2)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.765140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.770280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7e3ab-d5ca-4989-a172-c9b3f7113899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ed8ebfe79141cdaa9b3444fc204d86, user_id=ad51b0f1c6e74d4e8dcebeb080b98451, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:14.773347 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7e3ab-d5ca-4989-a172-c9b3f7113899 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:14.791114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1265/2550] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:14 2022] PUT /identity/v3/projects/08ed8ebfe79141cdaa9b3444fc204d86/users/ad51b0f1c6e74d4e8dcebeb080b98451/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:14.808763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01719f-6bfa-41f9-a5ea-bbb60ee802df None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.809216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01719f-6bfa-41f9-a5ea-bbb60ee802df None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.809679 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01719f-6bfa-41f9-a5ea-bbb60ee802df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.844188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6231d78f6bb478ca1d71acf855680b2', 'request_id': 'req-415b6556-68ec-4f10-89ef-4e14545755cb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.844502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dc01719f-6bfa-41f9-a5ea-bbb60ee802df None None] MFA Rules not processed for user `ad51b0f1c6e74d4e8dcebeb080b98451`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:14.846182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dc01719f-6bfa-41f9-a5ea-bbb60ee802df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.856334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6231d78f6bb478ca1d71acf855680b2', 'request_id': 'req-415b6556-68ec-4f10-89ef-4e14545755cb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.864490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6231d78f6bb478ca1d71acf855680b2', 'request_id': 'req-415b6556-68ec-4f10-89ef-4e14545755cb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.877721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] The token cache is being invalidate because project f6231d78f6bb478ca1d71acf855680b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:14.878053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.878718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-415b6556-68ec-4f10-89ef-4e14545755cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:14.880278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1286/2551] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:14 2022] DELETE /identity/v3/projects/f6231d78f6bb478ca1d71acf855680b2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:14.885145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546a0c-9de1-4f19-a9a2-f32ef6bb54da None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.885705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546a0c-9de1-4f19-a9a2-f32ef6bb54da None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.885978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546a0c-9de1-4f19-a9a2-f32ef6bb54da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.905769 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4c546a0c-9de1-4f19-a9a2-f32ef6bb54da None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:14.906978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4c546a0c-9de1-4f19-a9a2-f32ef6bb54da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.922635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1266/2552] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:14.933764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01719f-6bfa-41f9-a5ea-bbb60ee802df None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:14.935223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dc01719f-6bfa-41f9-a5ea-bbb60ee802df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:14.968967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1287/2553] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:14.978353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc6b0e-b9f7-46b2-8063-bb3d00aa00cf None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.978595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc6b0e-b9f7-46b2-8063-bb3d00aa00cf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.978860 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc6b0e-b9f7-46b2-8063-bb3d00aa00cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.993826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01719f-6bfa-41f9-a5ea-bbb60ee802df None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:14.998004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b623c-c6cd-40f2-9d3a-09d4d4c9b7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:14.998621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b623c-c6cd-40f2-9d3a-09d4d4c9b7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:14.998871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b623c-c6cd-40f2-9d3a-09d4d4c9b7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:14.999135 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b623c-c6cd-40f2-9d3a-09d4d4c9b7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:14.999313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-78fc6b0e-b9f7-46b2-8063-bb3d00aa00cf None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:15.000504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-78fc6b0e-b9f7-46b2-8063-bb3d00aa00cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:15.005170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:15.008924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1288/2554] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:15.010053 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b623c-c6cd-40f2-9d3a-09d4d4c9b7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.012434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b623c-c6cd-40f2-9d3a-09d4d4c9b7a3 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.014523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc6b0e-b9f7-46b2-8063-bb3d00aa00cf None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.022708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1267/2555] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:15.024049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc6b0e-b9f7-46b2-8063-bb3d00aa00cf None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.029147 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.029785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.030020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.030287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.030926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:15.031226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.032929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.045600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1289/2556] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:15.050961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b623c-c6cd-40f2-9d3a-09d4d4c9b7a3 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.062083 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b623c-c6cd-40f2-9d3a-09d4d4c9b7a3 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.066884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.067492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.067773 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.068048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.068757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.070670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.103411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1268/2557] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:15 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:15.107894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.121243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e944e84-2377-4172-a6ff-127e2880621a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.173361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.175258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:15.193177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:15.202073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1d18-052e-4f44-907c-d73378d18fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.202826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1d18-052e-4f44-907c-d73378d18fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.203114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1d18-052e-4f44-907c-d73378d18fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.203395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d1d18-052e-4f44-907c-d73378d18fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.204163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d1d18-052e-4f44-907c-d73378d18fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.207872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d1d18-052e-4f44-907c-d73378d18fb0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.233037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1290/2558] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:15 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:15.238344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1d18-052e-4f44-907c-d73378d18fb0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.248725 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d1d18-052e-4f44-907c-d73378d18fb0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.253248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8af274-a9eb-4525-8a57-dc8d090e17a8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.256176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a3f61-b71b-4a7e-8290-81c2f9670f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.257057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3f61-b71b-4a7e-8290-81c2f9670f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.257643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3f61-b71b-4a7e-8290-81c2f9670f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.257944 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3f61-b71b-4a7e-8290-81c2f9670f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.258593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a3f61-b71b-4a7e-8290-81c2f9670f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.258719 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.260287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a3f61-b71b-4a7e-8290-81c2f9670f89 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.261142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.261430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.262072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] PATH_INFO: `/v3/users/73b59aa85cbd45e280c179029afe6cda` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.263790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b59aa85cbd45e280c179029afe6cda)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.265765 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.276133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1291/2559] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:15.280716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a3f61-b71b-4a7e-8290-81c2f9670f89 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.293054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a3f61-b71b-4a7e-8290-81c2f9670f89 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.298532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203875-eb66-402e-bb6a-e37f3391dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.299395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203875-eb66-402e-bb6a-e37f3391dfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.300209 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203875-eb66-402e-bb6a-e37f3391dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.300503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203875-eb66-402e-bb6a-e37f3391dfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.301180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22203875-eb66-402e-bb6a-e37f3391dfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.303109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22203875-eb66-402e-bb6a-e37f3391dfe5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.318027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1292/2560] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:15.318848 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203875-eb66-402e-bb6a-e37f3391dfe5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.329856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203875-eb66-402e-bb6a-e37f3391dfe5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.335738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c7144-d066-4f44-b18b-4d772f78f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.335961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c7144-d066-4f44-b18b-4d772f78f5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.336914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c7144-d066-4f44-b18b-4d772f78f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.336914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c7144-d066-4f44-b18b-4d772f78f5ba admin admin] PATH_INFO: `/v3/projects/6cd384129154480982f76432f697b695/users/996cb390ff2f4f6fbe1b913101f28a85/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.347007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b59aa85cbd45e280c179029afe6cda'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:15.355795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c7144-d066-4f44-b18b-4d772f78f5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd384129154480982f76432f697b695, user_id=996cb390ff2f4f6fbe1b913101f28a85, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.359000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c7144-d066-4f44-b18b-4d772f78f5ba admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.363048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b59aa85cbd45e280c179029afe6cda'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:15.364042 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b59aa85cbd45e280c179029afe6cda'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:15.365283 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b59aa85cbd45e280c179029afe6cda'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:15.386224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1293/2561] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:15 2022] PUT /identity/v3/projects/6cd384129154480982f76432f697b695/users/996cb390ff2f4f6fbe1b913101f28a85/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:15.386993 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-32be9171-f2d6-4184-9ad3-db57a10eae34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b59aa85cbd45e280c179029afe6cda'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:15.389237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69502c7-141b-4a3a-9f7a-3628cd32e6af None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.389641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69502c7-141b-4a3a-9f7a-3628cd32e6af None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.389986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69502c7-141b-4a3a-9f7a-3628cd32e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.421236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1269/2562] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:15 2022] DELETE /identity/v3/users/73b59aa85cbd45e280c179029afe6cda => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:15.425360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc30b-8d77-4744-be84-5e41ded96155 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.425756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc30b-8d77-4744-be84-5e41ded96155 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.426119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc30b-8d77-4744-be84-5e41ded96155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.439762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d69502c7-141b-4a3a-9f7a-3628cd32e6af None None] MFA Rules not processed for user `996cb390ff2f4f6fbe1b913101f28a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:15.441184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d69502c7-141b-4a3a-9f7a-3628cd32e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:15.452570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a51cc30b-8d77-4744-be84-5e41ded96155 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:15.454464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a51cc30b-8d77-4744-be84-5e41ded96155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:15.516005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:15.522989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1294/2563] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:15.527658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69502c7-141b-4a3a-9f7a-3628cd32e6af None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.529333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d69502c7-141b-4a3a-9f7a-3628cd32e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:15.540320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1270/2564] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:15.544415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69502c7-141b-4a3a-9f7a-3628cd32e6af None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.551286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cc30b-8d77-4744-be84-5e41ded96155 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.551755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1671-5621-4f1e-b68a-b8da53e2aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.552403 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1671-5621-4f1e-b68a-b8da53e2aded admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.552707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1671-5621-4f1e-b68a-b8da53e2aded admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.552823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a51cc30b-8d77-4744-be84-5e41ded96155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:15.552980 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1671-5621-4f1e-b68a-b8da53e2aded admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.553607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e1671-5621-4f1e-b68a-b8da53e2aded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.555818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e1671-5621-4f1e-b68a-b8da53e2aded admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.591058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1295/2565] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:15 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:15.595182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1671-5621-4f1e-b68a-b8da53e2aded admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.620708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cc30b-8d77-4744-be84-5e41ded96155 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.663617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1671-5621-4f1e-b68a-b8da53e2aded admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.668365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1ca3e-20e5-4be3-985e-ab9dcf6c3143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.669177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ca3e-20e5-4be3-985e-ab9dcf6c3143 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.669514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ca3e-20e5-4be3-985e-ab9dcf6c3143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.669849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ca3e-20e5-4be3-985e-ab9dcf6c3143 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.670543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1ca3e-20e5-4be3-985e-ab9dcf6c3143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.672570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1ca3e-20e5-4be3-985e-ab9dcf6c3143 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.676342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f0828-9818-4497-a1a9-f67d25b9d70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.677091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0828-9818-4497-a1a9-f67d25b9d70f service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.677371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0828-9818-4497-a1a9-f67d25b9d70f service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.677641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0828-9818-4497-a1a9-f67d25b9d70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.685115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:15.690008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f0828-9818-4497-a1a9-f67d25b9d70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.691578 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f0828-9818-4497-a1a9-f67d25b9d70f service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.707532 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1296/2566] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:15 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:15.707751 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1271/2567] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:15.709017 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1ca3e-20e5-4be3-985e-ab9dcf6c3143 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.719381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1ca3e-20e5-4be3-985e-ab9dcf6c3143 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.724252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c8e0-0ea9-46a3-9837-42ea226f9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.724891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c8e0-0ea9-46a3-9837-42ea226f9192 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.725163 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c8e0-0ea9-46a3-9837-42ea226f9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.725429 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c8e0-0ea9-46a3-9837-42ea226f9192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.726069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9c8e0-0ea9-46a3-9837-42ea226f9192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.727666 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9c8e0-0ea9-46a3-9837-42ea226f9192 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.738244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1297/2568] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:15.742489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f0828-9818-4497-a1a9-f67d25b9d70f service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.753284 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f0828-9818-4497-a1a9-f67d25b9d70f service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.757934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ccc70-a1c8-4b1a-bb4f-45950eb01ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.758554 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ccc70-a1c8-4b1a-bb4f-45950eb01ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.758834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ccc70-a1c8-4b1a-bb4f-45950eb01ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.759108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ccc70-a1c8-4b1a-bb4f-45950eb01ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.759760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ccc70-a1c8-4b1a-bb4f-45950eb01ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.761436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ccc70-a1c8-4b1a-bb4f-45950eb01ca2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.778575 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1272/2569] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:15.783325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c8e0-0ea9-46a3-9837-42ea226f9192 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:15.794556 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c8e0-0ea9-46a3-9837-42ea226f9192 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:15.801325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf0b5-7a15-4659-ad7c-cc68b2d579c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:15.802058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf0b5-7a15-4659-ad7c-cc68b2d579c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.802214 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf0b5-7a15-4659-ad7c-cc68b2d579c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.802465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf0b5-7a15-4659-ad7c-cc68b2d579c4 admin admin] PATH_INFO: `/v3/projects/71a37ca1b96847a29d89d2107c99cc8d/users/7cdbe2ac3a944893b41da11e35a7324b/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.829395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf0b5-7a15-4659-ad7c-cc68b2d579c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a37ca1b96847a29d89d2107c99cc8d, user_id=7cdbe2ac3a944893b41da11e35a7324b, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:15.834694 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf0b5-7a15-4659-ad7c-cc68b2d579c4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:15.854059 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1298/2570] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:15 2022] PUT /identity/v3/projects/71a37ca1b96847a29d89d2107c99cc8d/users/7cdbe2ac3a944893b41da11e35a7324b/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:15.865439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dfb57-75c0-45e4-adc5-74970f01283f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:15.866143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dfb57-75c0-45e4-adc5-74970f01283f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:15.866638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dfb57-75c0-45e4-adc5-74970f01283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:15.901342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-661dfb57-75c0-45e4-adc5-74970f01283f None None] MFA Rules not processed for user `7cdbe2ac3a944893b41da11e35a7324b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:15.902584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-661dfb57-75c0-45e4-adc5-74970f01283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:15.978797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1273/2571] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:15.983234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf0b5-7a15-4659-ad7c-cc68b2d579c4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.054675 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf0b5-7a15-4659-ad7c-cc68b2d579c4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.062815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92127ea1-9354-475a-ac07-fe2ed561901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.063698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127ea1-9354-475a-ac07-fe2ed561901b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.064087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127ea1-9354-475a-ac07-fe2ed561901b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.064554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127ea1-9354-475a-ac07-fe2ed561901b admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.065216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92127ea1-9354-475a-ac07-fe2ed561901b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.068031 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92127ea1-9354-475a-ac07-fe2ed561901b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.100277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1299/2572] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:15 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:16.104031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661dfb57-75c0-45e4-adc5-74970f01283f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.116231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661dfb57-75c0-45e4-adc5-74970f01283f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.146768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:16.180449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629312-f94f-4f99-831b-c6181c96fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.181131 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629312-f94f-4f99-831b-c6181c96fe22 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.181348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629312-f94f-4f99-831b-c6181c96fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.181622 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629312-f94f-4f99-831b-c6181c96fe22 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.182265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75629312-f94f-4f99-831b-c6181c96fe22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.184261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75629312-f94f-4f99-831b-c6181c96fe22 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.213503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1274/2573] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:16 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:16.215142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92127ea1-9354-475a-ac07-fe2ed561901b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.227743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92127ea1-9354-475a-ac07-fe2ed561901b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.233003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ed84d-02a3-45cd-a6fc-bbfb7706e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.233624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed84d-02a3-45cd-a6fc-bbfb7706e7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.233902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed84d-02a3-45cd-a6fc-bbfb7706e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.234176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ed84d-02a3-45cd-a6fc-bbfb7706e7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.234822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ed84d-02a3-45cd-a6fc-bbfb7706e7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.236611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ed84d-02a3-45cd-a6fc-bbfb7706e7e1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.247740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1300/2574] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:16.252325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629312-f94f-4f99-831b-c6181c96fe22 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.263452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629312-f94f-4f99-831b-c6181c96fe22 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.268444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.269138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.269442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.269724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] PATH_INFO: `/v3/projects/abd8a747061d4cc187554152cca5cbf3/users/54a7175bbfec47b891a1bd51a121be7d/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.285562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd8a747061d4cc187554152cca5cbf3, user_id=54a7175bbfec47b891a1bd51a121be7d, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.288499 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.303906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1275/2575] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:16 2022] PUT /identity/v3/projects/abd8a747061d4cc187554152cca5cbf3/users/54a7175bbfec47b891a1bd51a121be7d/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:16.308125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ed84d-02a3-45cd-a6fc-bbfb7706e7e1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.319852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ed84d-02a3-45cd-a6fc-bbfb7706e7e1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.388668 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30282-5d8e-4fad-a887-9b5c390559ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.389274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30282-5d8e-4fad-a887-9b5c390559ee admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.389527 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30282-5d8e-4fad-a887-9b5c390559ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.389814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be30282-5d8e-4fad-a887-9b5c390559ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.390435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be30282-5d8e-4fad-a887-9b5c390559ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.392534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be30282-5d8e-4fad-a887-9b5c390559ee admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.405069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1301/2576] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:16.410057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.412081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:16.412210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30282-5d8e-4fad-a887-9b5c390559ee admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.424806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be30282-5d8e-4fad-a887-9b5c390559ee admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.429059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb734ba-72e0-4e39-82dd-0d3d5037eca9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.431670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161dff8-7910-4430-b662-e62d84fa425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.432853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161dff8-7910-4430-b662-e62d84fa425a admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.433236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161dff8-7910-4430-b662-e62d84fa425a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.433588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161dff8-7910-4430-b662-e62d84fa425a admin admin] PATH_INFO: `/v3/projects/abd8a747061d4cc187554152cca5cbf3/users/54a7175bbfec47b891a1bd51a121be7d/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.435061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.435758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.435889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161dff8-7910-4430-b662-e62d84fa425a admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd8a747061d4cc187554152cca5cbf3, user_id=54a7175bbfec47b891a1bd51a121be7d, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.436034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.436308 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] PATH_INFO: `/v3/projects/d29e0857626a446f9377d83359faa6f9` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.439713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29e0857626a446f9377d83359faa6f9)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.439871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161dff8-7910-4430-b662-e62d84fa425a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.440746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.468869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1302/2577] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:16 2022] PUT /identity/v3/projects/abd8a747061d4cc187554152cca5cbf3/users/54a7175bbfec47b891a1bd51a121be7d/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:16.472128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb171c-06b8-47c6-af5c-5dd501b25c5f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.485327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb171c-06b8-47c6-af5c-5dd501b25c5f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.486061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb171c-06b8-47c6-af5c-5dd501b25c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.512738 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29e0857626a446f9377d83359faa6f9', 'request_id': 'req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.523227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29e0857626a446f9377d83359faa6f9', 'request_id': 'req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.534501 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29e0857626a446f9377d83359faa6f9', 'request_id': 'req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.537686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-feeb171c-06b8-47c6-af5c-5dd501b25c5f None None] MFA Rules not processed for user `54a7175bbfec47b891a1bd51a121be7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:16.539558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-feeb171c-06b8-47c6-af5c-5dd501b25c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:16.550804 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:16.551731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] The token cache is being invalidate because project d29e0857626a446f9377d83359faa6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:16.552047 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.552837 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ad42f7b-288b-4fcb-8d8a-5d1341e40b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.555297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1276/2578] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:16 2022] DELETE /identity/v3/projects/d29e0857626a446f9377d83359faa6f9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:16.558826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050042-28aa-4dc9-81a6-fa8d6f0810b5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.559593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050042-28aa-4dc9-81a6-fa8d6f0810b5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.560191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050042-28aa-4dc9-81a6-fa8d6f0810b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.587676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ff050042-28aa-4dc9-81a6-fa8d6f0810b5 None None] MFA Rules not processed for user `ad51b0f1c6e74d4e8dcebeb080b98451`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:16.588980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ff050042-28aa-4dc9-81a6-fa8d6f0810b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:16.645218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1303/2579] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:16.646244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb171c-06b8-47c6-af5c-5dd501b25c5f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.647567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-feeb171c-06b8-47c6-af5c-5dd501b25c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:16.662825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1277/2580] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:16.664203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050042-28aa-4dc9-81a6-fa8d6f0810b5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.667701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ff050042-28aa-4dc9-81a6-fa8d6f0810b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:16.704652 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:16.751180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050042-28aa-4dc9-81a6-fa8d6f0810b5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.756051 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.756919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.757305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.757840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.757959 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb171c-06b8-47c6-af5c-5dd501b25c5f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.764005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.764931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.765235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.765494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] PATH_INFO: `/v3/users/496445e75e6e436c8046c6088934339a` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.766997 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=496445e75e6e436c8046c6088934339a)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.770528 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.770686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.771651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.784037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1278/2581] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:16.851109 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496445e75e6e436c8046c6088934339a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.853772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:16.855290 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:16.869265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be473d7c-7c64-4750-8925-49fa8ebf0d9c service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:16.875464 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8d02-3d1a-4c48-810a-492e591ecec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:16.876595 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8d02-3d1a-4c48-810a-492e591ecec0 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:16.877395 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8d02-3d1a-4c48-810a-492e591ecec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:16.877968 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8d02-3d1a-4c48-810a-492e591ecec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:16.878637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496445e75e6e436c8046c6088934339a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.881217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4dea8d02-3d1a-4c48-810a-492e591ecec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:16.891908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496445e75e6e436c8046c6088934339a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.893226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496445e75e6e436c8046c6088934339a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.897159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496445e75e6e436c8046c6088934339a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:16.927039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1304/2582] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:16 2022] DELETE /identity/v3/users/496445e75e6e436c8046c6088934339a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:16.964742 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea8d02-3d1a-4c48-810a-492e591ecec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:16.966609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea8d02-3d1a-4c48-810a-492e591ecec0 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:16.980940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1279/2583] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:17.899987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:17.901600 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:17.933447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:17.997228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91c2e-78ea-41a0-903b-d73929d685ac admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:18.004298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:18.006805 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.007764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.008455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] PATH_INFO: `/v3/projects/f052cab3995648b390a0e0ca8f1fc52f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.010593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f052cab3995648b390a0e0ca8f1fc52f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:18.015020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:18.084300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f052cab3995648b390a0e0ca8f1fc52f', 'request_id': 'req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:18.095130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f052cab3995648b390a0e0ca8f1fc52f', 'request_id': 'req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:18.102670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f052cab3995648b390a0e0ca8f1fc52f', 'request_id': 'req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:18.118468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] The token cache is being invalidate because project f052cab3995648b390a0e0ca8f1fc52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:18.118823 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:18.119428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f801b3b3-79e2-4fd3-91e4-0b233769a4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:18.121585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1305/2584] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:17 2022] DELETE /identity/v3/projects/f052cab3995648b390a0e0ca8f1fc52f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:18.126943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a9c0c-6a00-468e-87d4-9a971cf10020 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.127629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a9c0c-6a00-468e-87d4-9a971cf10020 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.127629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a9c0c-6a00-468e-87d4-9a971cf10020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.151474 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-508a9c0c-6a00-468e-87d4-9a971cf10020 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:18.152831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-508a9c0c-6a00-468e-87d4-9a971cf10020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:18.231638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1280/2585] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:18.239601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104fe3-843e-48c0-b03e-68bdee15c4ac None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.239881 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104fe3-843e-48c0-b03e-68bdee15c4ac None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.240146 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104fe3-843e-48c0-b03e-68bdee15c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.262198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3d104fe3-843e-48c0-b03e-68bdee15c4ac None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:18.263411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3d104fe3-843e-48c0-b03e-68bdee15c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:18.271829 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1306/2586] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:18.276096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a9c0c-6a00-468e-87d4-9a971cf10020 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:18.288852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a9c0c-6a00-468e-87d4-9a971cf10020 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:18.292644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:18.293247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.293695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.293980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.294635 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:18.294956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:18.296744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:18.326505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d104fe3-843e-48c0-b03e-68bdee15c4ac None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:18.326932 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1281/2587] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:18.338187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d104fe3-843e-48c0-b03e-68bdee15c4ac None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:18.343454 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70404fee-f411-4264-9493-1beedd5ccf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:18.344123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70404fee-f411-4264-9493-1beedd5ccf96 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.344475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70404fee-f411-4264-9493-1beedd5ccf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.344759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70404fee-f411-4264-9493-1beedd5ccf96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.345559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70404fee-f411-4264-9493-1beedd5ccf96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:18.347633 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70404fee-f411-4264-9493-1beedd5ccf96 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:18.388299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1307/2588] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:18 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:18.389811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:18.402689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff332ae-1986-46ea-9106-8c6fa456952a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:18.455549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:18.466490 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40366f-c329-4313-a7b3-332b32b56cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:18.467115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40366f-c329-4313-a7b3-332b32b56cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.467391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40366f-c329-4313-a7b3-332b32b56cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.467664 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40366f-c329-4313-a7b3-332b32b56cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.468329 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40366f-c329-4313-a7b3-332b32b56cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:18.470411 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40366f-c329-4313-a7b3-332b32b56cc6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:18.497767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1282/2589] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:18 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:18.499118 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70404fee-f411-4264-9493-1beedd5ccf96 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:18.510425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70404fee-f411-4264-9493-1beedd5ccf96 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:18.516020 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe415-9d6d-4456-ab02-aae3ab8f9dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:18.516960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe415-9d6d-4456-ab02-aae3ab8f9dac admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.517399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe415-9d6d-4456-ab02-aae3ab8f9dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.517803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe415-9d6d-4456-ab02-aae3ab8f9dac admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.518627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fe415-9d6d-4456-ab02-aae3ab8f9dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:18.520473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fe415-9d6d-4456-ab02-aae3ab8f9dac admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:18.535564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1308/2590] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:18.536909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40366f-c329-4313-a7b3-332b32b56cc6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:18.547515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40366f-c329-4313-a7b3-332b32b56cc6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:18.553245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522eeb1-8c90-4f26-81bd-05b51590a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:18.553879 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522eeb1-8c90-4f26-81bd-05b51590a750 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.554598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522eeb1-8c90-4f26-81bd-05b51590a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.554598 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522eeb1-8c90-4f26-81bd-05b51590a750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.555079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522eeb1-8c90-4f26-81bd-05b51590a750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:18.556772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522eeb1-8c90-4f26-81bd-05b51590a750 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:18.581303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1283/2591] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:18.586480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe415-9d6d-4456-ab02-aae3ab8f9dac admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:18.602615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe415-9d6d-4456-ab02-aae3ab8f9dac admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:18.608242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed2a34-18d5-4da3-864e-98eaf37ecd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:18.609100 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2a34-18d5-4da3-864e-98eaf37ecd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.609380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2a34-18d5-4da3-864e-98eaf37ecd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.609651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2a34-18d5-4da3-864e-98eaf37ecd9c admin admin] PATH_INFO: `/v3/projects/ea05bbe511c64084aba17e1fbb01e0e6/users/6418f1f03cb2470c9838c3db027f69bc/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.630519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed2a34-18d5-4da3-864e-98eaf37ecd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea05bbe511c64084aba17e1fbb01e0e6, user_id=6418f1f03cb2470c9838c3db027f69bc, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:18.633750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed2a34-18d5-4da3-864e-98eaf37ecd9c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:18.660861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1309/2592] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:18 2022] PUT /identity/v3/projects/ea05bbe511c64084aba17e1fbb01e0e6/users/6418f1f03cb2470c9838c3db027f69bc/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:18.680611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156ab7-7080-4d47-bfa8-ffc5d6e03775 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.681488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156ab7-7080-4d47-bfa8-ffc5d6e03775 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.682334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156ab7-7080-4d47-bfa8-ffc5d6e03775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.734265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-27156ab7-7080-4d47-bfa8-ffc5d6e03775 None None] MFA Rules not processed for user `6418f1f03cb2470c9838c3db027f69bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:18.735735 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-27156ab7-7080-4d47-bfa8-ffc5d6e03775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:18.820015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1284/2593] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:18.825953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed2a34-18d5-4da3-864e-98eaf37ecd9c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:18.900976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:18.939005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed2a34-18d5-4da3-864e-98eaf37ecd9c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:18.948836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5b8bc-10b7-469d-9a94-ac4df6d8248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:18.949472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5b8bc-10b7-469d-9a94-ac4df6d8248b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:18.949750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5b8bc-10b7-469d-9a94-ac4df6d8248b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:18.950023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5b8bc-10b7-469d-9a94-ac4df6d8248b admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:18.950659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5b8bc-10b7-469d-9a94-ac4df6d8248b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:18.952628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5b8bc-10b7-469d-9a94-ac4df6d8248b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:19.001884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1310/2594] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:18 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:19.002935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156ab7-7080-4d47-bfa8-ffc5d6e03775 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:19.023163 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156ab7-7080-4d47-bfa8-ffc5d6e03775 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:19.094036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fff4a-e4f2-4607-b082-1ab7125496aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:19.095190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fff4a-e4f2-4607-b082-1ab7125496aa admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.095479 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fff4a-e4f2-4607-b082-1ab7125496aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.095855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fff4a-e4f2-4607-b082-1ab7125496aa admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.096430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fff4a-e4f2-4607-b082-1ab7125496aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:19.098640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fff4a-e4f2-4607-b082-1ab7125496aa admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:19.127469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1285/2595] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:19 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:19.131731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5b8bc-10b7-469d-9a94-ac4df6d8248b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:19.148478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5b8bc-10b7-469d-9a94-ac4df6d8248b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:19.154651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee74718-0a6d-4d3d-a787-5723d5032fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:19.155282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee74718-0a6d-4d3d-a787-5723d5032fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.156298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee74718-0a6d-4d3d-a787-5723d5032fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.156616 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee74718-0a6d-4d3d-a787-5723d5032fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.157324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee74718-0a6d-4d3d-a787-5723d5032fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:19.159344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee74718-0a6d-4d3d-a787-5723d5032fb6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:19.179277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1311/2596] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:19.180580 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fff4a-e4f2-4607-b082-1ab7125496aa admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:19.193297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fff4a-e4f2-4607-b082-1ab7125496aa admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:19.198231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7effae0-5ef6-4210-9975-6ff1fc98165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:19.198913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7effae0-5ef6-4210-9975-6ff1fc98165c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.199297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7effae0-5ef6-4210-9975-6ff1fc98165c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.199470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7effae0-5ef6-4210-9975-6ff1fc98165c admin admin] PATH_INFO: `/v3/projects/effa79d39a7e4d1596441ee8ebf94d82/users/c97840011c744b7e840f99eb1cda0b56/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.217623 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7effae0-5ef6-4210-9975-6ff1fc98165c admin admin] RBAC: Authorizing `identity:create_grant(project_id=effa79d39a7e4d1596441ee8ebf94d82, user_id=c97840011c744b7e840f99eb1cda0b56, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:19.220836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7effae0-5ef6-4210-9975-6ff1fc98165c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:19.238049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1286/2597] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:19 2022] PUT /identity/v3/projects/effa79d39a7e4d1596441ee8ebf94d82/users/c97840011c744b7e840f99eb1cda0b56/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:19.242635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee74718-0a6d-4d3d-a787-5723d5032fb6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:19.257918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee74718-0a6d-4d3d-a787-5723d5032fb6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:19.354819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d56a60-7374-40a3-9b62-2cde49bf32f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:19.355465 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56a60-7374-40a3-9b62-2cde49bf32f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.355741 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56a60-7374-40a3-9b62-2cde49bf32f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.356004 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56a60-7374-40a3-9b62-2cde49bf32f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.356720 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d56a60-7374-40a3-9b62-2cde49bf32f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:19.358324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d56a60-7374-40a3-9b62-2cde49bf32f4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:19.373221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1312/2598] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:19.378125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7effae0-5ef6-4210-9975-6ff1fc98165c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:19.392583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7effae0-5ef6-4210-9975-6ff1fc98165c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:19.400733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:19.401675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.401958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.402232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] PATH_INFO: `/v3/projects/effa79d39a7e4d1596441ee8ebf94d82/users/c97840011c744b7e840f99eb1cda0b56/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.404230 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] RBAC: Authorizing `identity:create_grant(project_id=effa79d39a7e4d1596441ee8ebf94d82, user_id=c97840011c744b7e840f99eb1cda0b56, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:19.407060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:19.422316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1287/2599] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:19 2022] PUT /identity/v3/projects/effa79d39a7e4d1596441ee8ebf94d82/users/c97840011c744b7e840f99eb1cda0b56/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:19.434213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b539dcc-f4ee-4b88-ac34-ead6fd27641a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.434506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b539dcc-f4ee-4b88-ac34-ead6fd27641a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.434790 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b539dcc-f4ee-4b88-ac34-ead6fd27641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.490578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7b539dcc-f4ee-4b88-ac34-ead6fd27641a None None] MFA Rules not processed for user `c97840011c744b7e840f99eb1cda0b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:19.491969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7b539dcc-f4ee-4b88-ac34-ead6fd27641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:19.571282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1313/2600] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:19.586125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:19.587851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:19.602629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:19.651831 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0736e93-68a2-4edf-9e28-ecc569b3467d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:19.655472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16ef9c-f617-4ba2-b149-bb9e57526c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:19.656355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16ef9c-f617-4ba2-b149-bb9e57526c5a service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.656573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16ef9c-f617-4ba2-b149-bb9e57526c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.656845 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16ef9c-f617-4ba2-b149-bb9e57526c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.667343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16ef9c-f617-4ba2-b149-bb9e57526c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:19.668856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16ef9c-f617-4ba2-b149-bb9e57526c5a service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:19.680559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1288/2601] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:19.751137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b539dcc-f4ee-4b88-ac34-ead6fd27641a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:19.803169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:19.823341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b539dcc-f4ee-4b88-ac34-ead6fd27641a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:19.828678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:19.829334 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.829637 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.829937 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] PATH_INFO: `/v3/users/6418f1f03cb2470c9838c3db027f69bc` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.831202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6418f1f03cb2470c9838c3db027f69bc)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:19.833236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:19.887577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6418f1f03cb2470c9838c3db027f69bc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:19.903244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6418f1f03cb2470c9838c3db027f69bc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:19.914560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6418f1f03cb2470c9838c3db027f69bc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:19.915239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6418f1f03cb2470c9838c3db027f69bc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:19.915891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6418f1f03cb2470c9838c3db027f69bc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:19.931528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1314/2602] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:19 2022] DELETE /identity/v3/users/6418f1f03cb2470c9838c3db027f69bc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:19.936376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066458-9326-40ba-96bd-d5c04e007edb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:19.936817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066458-9326-40ba-96bd-d5c04e007edb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:19.937080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066458-9326-40ba-96bd-d5c04e007edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:19.958151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a8066458-9326-40ba-96bd-d5c04e007edb None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:19.959384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a8066458-9326-40ba-96bd-d5c04e007edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:20.028937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1289/2603] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:20.041084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:20.042657 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:20.114548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387175-3514-4100-9244-eb7d94926b97 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:20.119356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f03c2-412f-452d-b248-868fdf0f06e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:20.120043 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f03c2-412f-452d-b248-868fdf0f06e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:20.120658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f03c2-412f-452d-b248-868fdf0f06e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:20.120926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f03c2-412f-452d-b248-868fdf0f06e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:20.134282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f03c2-412f-452d-b248-868fdf0f06e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:20.135819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f03c2-412f-452d-b248-868fdf0f06e4 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:20.147127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1315/2604] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:20.289927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8066458-9326-40ba-96bd-d5c04e007edb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:20.291910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a8066458-9326-40ba-96bd-d5c04e007edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:20.305942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8066458-9326-40ba-96bd-d5c04e007edb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:20.311125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:20.311861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:20.312610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:20.312610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] PATH_INFO: `/v3/users/996cb390ff2f4f6fbe1b913101f28a85` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:20.314038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996cb390ff2f4f6fbe1b913101f28a85)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:20.316220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:20.379692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996cb390ff2f4f6fbe1b913101f28a85'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.389173 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996cb390ff2f4f6fbe1b913101f28a85'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.389956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996cb390ff2f4f6fbe1b913101f28a85'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.390788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996cb390ff2f4f6fbe1b913101f28a85'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.405720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996cb390ff2f4f6fbe1b913101f28a85'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.436134 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1290/2605] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:20 2022] DELETE /identity/v3/users/996cb390ff2f4f6fbe1b913101f28a85 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:20.441932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8cd6-71f1-47cf-b38e-d7921b731709 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:20.442350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8cd6-71f1-47cf-b38e-d7921b731709 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:20.443094 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8cd6-71f1-47cf-b38e-d7921b731709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:20.473023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-406a8cd6-71f1-47cf-b38e-d7921b731709 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:20.474667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-406a8cd6-71f1-47cf-b38e-d7921b731709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:20.482625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:20.484291 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:20.553216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:20.579381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1316/2606] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:20.587449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8cd6-71f1-47cf-b38e-d7921b731709 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:20.589357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-406a8cd6-71f1-47cf-b38e-d7921b731709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:20.597364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3749e5-2b28-43db-8c8b-c40cf90b7bc3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:20.605190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:20.605635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:20.607063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:20.607536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:20.608005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] PATH_INFO: `/v3/projects/ea05bbe511c64084aba17e1fbb01e0e6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:20.610790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea05bbe511c64084aba17e1fbb01e0e6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:20.614292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:20.679068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8cd6-71f1-47cf-b38e-d7921b731709 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:20.699301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea05bbe511c64084aba17e1fbb01e0e6', 'request_id': 'req-e3329d8b-abb8-485f-8af7-91c01f349adf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.709079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea05bbe511c64084aba17e1fbb01e0e6', 'request_id': 'req-e3329d8b-abb8-485f-8af7-91c01f349adf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.724372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea05bbe511c64084aba17e1fbb01e0e6', 'request_id': 'req-e3329d8b-abb8-485f-8af7-91c01f349adf'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.752542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] The token cache is being invalidate because project ea05bbe511c64084aba17e1fbb01e0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:20.753011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.754187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.757615 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:20.758624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:20.759155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:20.759629 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:20.762071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1291/2607] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:20 2022] DELETE /identity/v3/projects/ea05bbe511c64084aba17e1fbb01e0e6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:20.763162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:20.763489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:20.773001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:20.868254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:20.869807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:20.882447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3329d8b-abb8-485f-8af7-91c01f349adf admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:20.882696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1317/2608] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:20.887947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:20.888668 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:20.888953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:20.889234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] PATH_INFO: `/v3/users/c97840011c744b7e840f99eb1cda0b56` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:20.890414 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97840011c744b7e840f99eb1cda0b56)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:20.896792 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:20.976276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97840011c744b7e840f99eb1cda0b56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.987207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97840011c744b7e840f99eb1cda0b56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.987858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97840011c744b7e840f99eb1cda0b56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.988517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97840011c744b7e840f99eb1cda0b56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:20.994259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:20.998963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97840011c744b7e840f99eb1cda0b56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.029994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1292/2609] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:20 2022] DELETE /identity/v3/users/c97840011c744b7e840f99eb1cda0b56 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:21.451021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:21.452498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:21.464929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e427a-cc72-4c87-a869-998eed833fa8 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:21.535278 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:21.535996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:21.536651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:21.536930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] PATH_INFO: `/v3/projects/6cd384129154480982f76432f697b695` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:21.538291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd384129154480982f76432f697b695)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:21.540320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:21.557847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:21.601341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd384129154480982f76432f697b695', 'request_id': 'req-63dc6d2d-efbd-4f8e-add2-80478532e291'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.610444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd384129154480982f76432f697b695', 'request_id': 'req-63dc6d2d-efbd-4f8e-add2-80478532e291'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.619356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd384129154480982f76432f697b695', 'request_id': 'req-63dc6d2d-efbd-4f8e-add2-80478532e291'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.632677 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] The token cache is being invalidate because project 6cd384129154480982f76432f697b695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:21.632963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.633644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.635664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1318/2610] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:21 2022] DELETE /identity/v3/projects/6cd384129154480982f76432f697b695 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:21.641255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:21.643771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:21.653101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:21.654592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:21.662543 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b836b-7599-45cc-ab6f-f663a31f91f6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:21.745590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6d2d-efbd-4f8e-add2-80478532e291 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:21.751620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:21.752458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:21.752813 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:21.753193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] PATH_INFO: `/v3/projects/effa79d39a7e4d1596441ee8ebf94d82` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:21.754964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=effa79d39a7e4d1596441ee8ebf94d82)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:21.757502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:21.820845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effa79d39a7e4d1596441ee8ebf94d82', 'request_id': 'req-c87990c5-b9be-4475-b1be-ccca8c5c7e56'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.832736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effa79d39a7e4d1596441ee8ebf94d82', 'request_id': 'req-c87990c5-b9be-4475-b1be-ccca8c5c7e56'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.841561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effa79d39a7e4d1596441ee8ebf94d82', 'request_id': 'req-c87990c5-b9be-4475-b1be-ccca8c5c7e56'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.854691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] The token cache is being invalidate because project effa79d39a7e4d1596441ee8ebf94d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:21.854992 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.856246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c87990c5-b9be-4475-b1be-ccca8c5c7e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.862268 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1319/2611] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:21 2022] DELETE /identity/v3/projects/effa79d39a7e4d1596441ee8ebf94d82 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:21.863846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8a6f-eeed-4a20-af6a-33014b13e2fd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:21.864132 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8a6f-eeed-4a20-af6a-33014b13e2fd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:21.864420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb8a6f-eeed-4a20-af6a-33014b13e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:21.875110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:21.877398 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:21.877929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:21.878294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] PATH_INFO: `/v3/users/7cdbe2ac3a944893b41da11e35a7324b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:21.880563 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdbe2ac3a944893b41da11e35a7324b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:21.882155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:21.888113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-cddb8a6f-eeed-4a20-af6a-33014b13e2fd None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:21.889353 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cddb8a6f-eeed-4a20-af6a-33014b13e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:21.920453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:21.945991 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdbe2ac3a944893b41da11e35a7324b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.957573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdbe2ac3a944893b41da11e35a7324b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.959605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdbe2ac3a944893b41da11e35a7324b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.960157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdbe2ac3a944893b41da11e35a7324b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.960910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1320/2612] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:21.970050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45cca-cc2e-4da2-96df-d9e64d081400 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:21.970050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45cca-cc2e-4da2-96df-d9e64d081400 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:21.970050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45cca-cc2e-4da2-96df-d9e64d081400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:21.974888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdbe2ac3a944893b41da11e35a7324b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:21.997602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1293/2613] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:21 2022] DELETE /identity/v3/users/7cdbe2ac3a944893b41da11e35a7324b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:21.998861 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-63f45cca-cc2e-4da2-96df-d9e64d081400 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:22.000121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-63f45cca-cc2e-4da2-96df-d9e64d081400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:22.089226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1321/2614] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:22.090404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.103029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e586-e5a5-45a0-b3db-6b1f810d0f16 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.109906 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.110621 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.110911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.111624 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.112277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:22.112644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.114307 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.129714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1294/2615] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:39:22.136595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f45cca-cc2e-4da2-96df-d9e64d081400 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.150192 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f45cca-cc2e-4da2-96df-d9e64d081400 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.158080 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4a11-79e8-4915-a485-f95ac7d6c983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.158538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4a11-79e8-4915-a485-f95ac7d6c983 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.159087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4a11-79e8-4915-a485-f95ac7d6c983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.159489 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4a11-79e8-4915-a485-f95ac7d6c983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.160596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4a11-79e8-4915-a485-f95ac7d6c983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.163051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4a11-79e8-4915-a485-f95ac7d6c983 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.201964 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1322/2616] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:22 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:22.207069 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.219029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60221a8-c610-430c-bd07-779965d95dd9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.263245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:22.286431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08d05-29bc-4a04-bebd-5a37addc8347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.287341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08d05-29bc-4a04-bebd-5a37addc8347 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.287341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08d05-29bc-4a04-bebd-5a37addc8347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.287583 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08d05-29bc-4a04-bebd-5a37addc8347 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.288231 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e08d05-29bc-4a04-bebd-5a37addc8347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.290418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e08d05-29bc-4a04-bebd-5a37addc8347 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.322058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1295/2617] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:22 2022] POST /identity/v3/users => generated 301 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:22.323305 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4a11-79e8-4915-a485-f95ac7d6c983 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.335318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4a11-79e8-4915-a485-f95ac7d6c983 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.340651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c7fe-b5c0-46b0-964e-96c666c2331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.341759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c7fe-b5c0-46b0-964e-96c666c2331c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.341759 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c7fe-b5c0-46b0-964e-96c666c2331c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.342093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c7fe-b5c0-46b0-964e-96c666c2331c admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.342586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c7fe-b5c0-46b0-964e-96c666c2331c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.344251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c7fe-b5c0-46b0-964e-96c666c2331c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.360907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1323/2618] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:22.362757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08d05-29bc-4a04-bebd-5a37addc8347 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.373251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08d05-29bc-4a04-bebd-5a37addc8347 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.380280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c2f99-6bcf-4373-a16c-fe966d2ff65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.380937 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2f99-6bcf-4373-a16c-fe966d2ff65a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.381232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2f99-6bcf-4373-a16c-fe966d2ff65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.381503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2f99-6bcf-4373-a16c-fe966d2ff65a admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.382139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c2f99-6bcf-4373-a16c-fe966d2ff65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.383761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c2f99-6bcf-4373-a16c-fe966d2ff65a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.397039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1296/2619] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:22.401608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c7fe-b5c0-46b0-964e-96c666c2331c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.413499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c7fe-b5c0-46b0-964e-96c666c2331c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.418251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d85080-9343-4138-bef6-af32cd431dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.420925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d85080-9343-4138-bef6-af32cd431dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.421316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d85080-9343-4138-bef6-af32cd431dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.421688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d85080-9343-4138-bef6-af32cd431dba admin admin] PATH_INFO: `/v3/projects/a29777bdad46410b9d8b4cb79069c128/users/38a9bcc2014c4f2390378339d25ac2fe/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.457723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d85080-9343-4138-bef6-af32cd431dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29777bdad46410b9d8b4cb79069c128, user_id=38a9bcc2014c4f2390378339d25ac2fe, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.462411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d85080-9343-4138-bef6-af32cd431dba admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.496991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1324/2620] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:22 2022] PUT /identity/v3/projects/a29777bdad46410b9d8b4cb79069c128/users/38a9bcc2014c4f2390378339d25ac2fe/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:22.501725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b1d06-8815-4d01-97cc-88b5023b58df None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.502058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b1d06-8815-4d01-97cc-88b5023b58df None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.502283 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b1d06-8815-4d01-97cc-88b5023b58df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.538288 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ab4b1d06-8815-4d01-97cc-88b5023b58df None None] MFA Rules not processed for user `38a9bcc2014c4f2390378339d25ac2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:22.539545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ab4b1d06-8815-4d01-97cc-88b5023b58df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:22.644208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1297/2621] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:22.650203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d85080-9343-4138-bef6-af32cd431dba admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.681637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b1d06-8815-4d01-97cc-88b5023b58df None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.694817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ab4b1d06-8815-4d01-97cc-88b5023b58df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:22.755019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d85080-9343-4138-bef6-af32cd431dba admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.762962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2303-6a1c-4f97-827d-b64448ccd6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.763560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2303-6a1c-4f97-827d-b64448ccd6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.763836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2303-6a1c-4f97-827d-b64448ccd6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.764110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2303-6a1c-4f97-827d-b64448ccd6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.764796 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2303-6a1c-4f97-827d-b64448ccd6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.767504 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2303-6a1c-4f97-827d-b64448ccd6e2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.780896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b1d06-8815-4d01-97cc-88b5023b58df None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.786187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.787044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.787375 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.787670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] PATH_INFO: `/v3/projects/71a37ca1b96847a29d89d2107c99cc8d` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.788864 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a37ca1b96847a29d89d2107c99cc8d)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.790858 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.805068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1325/2622] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:22 2022] POST /identity/v3/projects => generated 401 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:22.809102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2303-6a1c-4f97-827d-b64448ccd6e2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.814836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:22.850048 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a37ca1b96847a29d89d2107c99cc8d', 'request_id': 'req-72d1f16d-99cb-4602-be82-48dbf3f930e8'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:22.852835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:22.858001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a37ca1b96847a29d89d2107c99cc8d', 'request_id': 'req-72d1f16d-99cb-4602-be82-48dbf3f930e8'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:22.868241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a37ca1b96847a29d89d2107c99cc8d', 'request_id': 'req-72d1f16d-99cb-4602-be82-48dbf3f930e8'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:22.879941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2303-6a1c-4f97-827d-b64448ccd6e2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.880373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] The token cache is being invalidate because project 71a37ca1b96847a29d89d2107c99cc8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:22.880697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:22.881376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:22.883094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1298/2623] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:22 2022] DELETE /identity/v3/projects/71a37ca1b96847a29d89d2107c99cc8d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:22.887197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.888574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:22.941064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.941696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.941970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.942226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.942892 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.944974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.954800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1f16d-99cb-4602-be82-48dbf3f930e8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.960203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.960873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.961188 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.961428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] PATH_INFO: `/v3/users/54a7175bbfec47b891a1bd51a121be7d` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.962568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a7175bbfec47b891a1bd51a121be7d)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.964689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:22.969260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1326/2624] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:22 2022] POST /identity/v3/users => generated 307 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:22.973564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:22.975393 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:22.987479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a2ef1-f79d-42f4-a2d4-a19fa02afdc3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:22.992900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62737b-46d9-4fe6-8aba-3e90bb1e9015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:22.993509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62737b-46d9-4fe6-8aba-3e90bb1e9015 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:22.993820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62737b-46d9-4fe6-8aba-3e90bb1e9015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:22.994116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62737b-46d9-4fe6-8aba-3e90bb1e9015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:22.994838 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62737b-46d9-4fe6-8aba-3e90bb1e9015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:22.996469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62737b-46d9-4fe6-8aba-3e90bb1e9015 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.007499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1327/2625] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:23.012240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62737b-46d9-4fe6-8aba-3e90bb1e9015 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.016788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a7175bbfec47b891a1bd51a121be7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.022144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62737b-46d9-4fe6-8aba-3e90bb1e9015 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.025749 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a7175bbfec47b891a1bd51a121be7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.026388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a7175bbfec47b891a1bd51a121be7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.027167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a7175bbfec47b891a1bd51a121be7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.027283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6a01b-4fe7-4620-941c-7ae5a3b35a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:23.027940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6a01b-4fe7-4620-941c-7ae5a3b35a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.028281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6a01b-4fe7-4620-941c-7ae5a3b35a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.028520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6a01b-4fe7-4620-941c-7ae5a3b35a5f admin admin] PATH_INFO: `/v3/projects/ecd02be56d804eb7a71ec47c1ba6bdde/users/f453e1ba3e8e442681a8ccbf023c042b/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.035698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a7175bbfec47b891a1bd51a121be7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.044920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6a01b-4fe7-4620-941c-7ae5a3b35a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd02be56d804eb7a71ec47c1ba6bdde, user_id=f453e1ba3e8e442681a8ccbf023c042b, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:23.047663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6a01b-4fe7-4620-941c-7ae5a3b35a5f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.054926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1299/2626] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:22 2022] DELETE /identity/v3/users/54a7175bbfec47b891a1bd51a121be7d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:23.063328 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1328/2627] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:23 2022] PUT /identity/v3/projects/ecd02be56d804eb7a71ec47c1ba6bdde/users/f453e1ba3e8e442681a8ccbf023c042b/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:23.067761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.069239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.140948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d435d14-d053-437d-af4f-202fec5bbd01 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.145076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:23.199809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8ae92-e727-4aa3-8933-87c4ef6741ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:23.200661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ae92-e727-4aa3-8933-87c4ef6741ec admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.204615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ae92-e727-4aa3-8933-87c4ef6741ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.205111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ae92-e727-4aa3-8933-87c4ef6741ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.205768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8ae92-e727-4aa3-8933-87c4ef6741ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:23.208095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8ae92-e727-4aa3-8933-87c4ef6741ec admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.220688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1300/2628] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:23.224740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6a01b-4fe7-4620-941c-7ae5a3b35a5f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.237555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6a01b-4fe7-4620-941c-7ae5a3b35a5f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.249661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:23.250308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.250603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.251098 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] PATH_INFO: `/v3/projects/ecd02be56d804eb7a71ec47c1ba6bdde/users/f453e1ba3e8e442681a8ccbf023c042b/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.253784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd02be56d804eb7a71ec47c1ba6bdde, user_id=f453e1ba3e8e442681a8ccbf023c042b, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:23.257778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.273507 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1329/2629] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:23 2022] PUT /identity/v3/projects/ecd02be56d804eb7a71ec47c1ba6bdde/users/f453e1ba3e8e442681a8ccbf023c042b/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:23.279732 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9d030-ee4f-4112-a8aa-36e05d942cd8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.280019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9d030-ee4f-4112-a8aa-36e05d942cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.283004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9d030-ee4f-4112-a8aa-36e05d942cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.316774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ccd9d030-ee4f-4112-a8aa-36e05d942cd8 None None] MFA Rules not processed for user `f453e1ba3e8e442681a8ccbf023c042b`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:23.318420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ccd9d030-ee4f-4112-a8aa-36e05d942cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.336698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.339240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.405559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1301/2630] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:23.406463 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9d030-ee4f-4112-a8aa-36e05d942cd8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.407848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ccd9d030-ee4f-4112-a8aa-36e05d942cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.418252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc182727-201e-4e6d-9f76-214624f2721b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.424154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:23.425215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.425575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.426195 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.427908 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.434537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:23.482604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9d030-ee4f-4112-a8aa-36e05d942cd8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.488677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:23.489327 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.489602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.489873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] PATH_INFO: `/v3/projects/abd8a747061d4cc187554152cca5cbf3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.491023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd8a747061d4cc187554152cca5cbf3)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:23.493008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.505288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:23.506869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.518744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1330/2631] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:23.519715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.526243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.538292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:23.560659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd8a747061d4cc187554152cca5cbf3', 'request_id': 'req-ce52c43c-6aa3-4079-ae61-24cfcd802fda'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.568673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd8a747061d4cc187554152cca5cbf3', 'request_id': 'req-ce52c43c-6aa3-4079-ae61-24cfcd802fda'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.579963 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd8a747061d4cc187554152cca5cbf3', 'request_id': 'req-ce52c43c-6aa3-4079-ae61-24cfcd802fda'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.595594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5141a6f-605f-4461-9b30-009a21e2bc18 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.602252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] The token cache is being invalidate because project abd8a747061d4cc187554152cca5cbf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:23.602899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.604853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ce52c43c-6aa3-4079-ae61-24cfcd802fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:23.607515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1302/2632] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:23 2022] DELETE /identity/v3/projects/abd8a747061d4cc187554152cca5cbf3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:23.614037 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e4f9c-b358-41a9-a95f-45f54a8bccdc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.614322 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e4f9c-b358-41a9-a95f-45f54a8bccdc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.614630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e4f9c-b358-41a9-a95f-45f54a8bccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.642715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0f1e4f9c-b358-41a9-a95f-45f54a8bccdc None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:23.644678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0f1e4f9c-b358-41a9-a95f-45f54a8bccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.682814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:23.683444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.683719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.684011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.685902 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.721000 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1303/2633] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:23.728492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee366a2-a803-4803-bb37-c8982088a2f0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.728791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee366a2-a803-4803-bb37-c8982088a2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.729074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee366a2-a803-4803-bb37-c8982088a2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.763355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5ee366a2-a803-4803-bb37-c8982088a2f0 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:23.766076 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5ee366a2-a803-4803-bb37-c8982088a2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.786772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1304/2634] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:23.788891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee366a2-a803-4803-bb37-c8982088a2f0 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.790252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:23.791705 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.800825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee366a2-a803-4803-bb37-c8982088a2f0 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.804423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1331/2635] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:23.808212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:23.809241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.809533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.810011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.811015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:23.811234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:23.817628 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.852576 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1305/2636] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:23.856110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.868273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e706-ab13-4002-8b28-366afc9be027 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.873364 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb81af-d898-4112-97bf-612036a4aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:23.874025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb81af-d898-4112-97bf-612036a4aeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:23.874356 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb81af-d898-4112-97bf-612036a4aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:23.874630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb81af-d898-4112-97bf-612036a4aeb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:23.875281 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb81af-d898-4112-97bf-612036a4aeb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:23.877934 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb81af-d898-4112-97bf-612036a4aeb0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:23.883437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:23.909021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:23.910768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:23.927978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da108-1b96-4a80-9b6e-f11eedc28816 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:23.931399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1332/2637] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:23 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:23.936543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb81af-d898-4112-97bf-612036a4aeb0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.027240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb81af-d898-4112-97bf-612036a4aeb0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.028346 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.029319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.029788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.030328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.033359 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:24.034643 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919a379-7adc-41dd-8a23-a2c580b2e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.035283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a379-7adc-41dd-8a23-a2c580b2e563 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.035560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a379-7adc-41dd-8a23-a2c580b2e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.036593 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a379-7adc-41dd-8a23-a2c580b2e563 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.037760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a379-7adc-41dd-8a23-a2c580b2e563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.041966 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a379-7adc-41dd-8a23-a2c580b2e563 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.078241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1333/2638] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:23 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:24.083380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919a379-7adc-41dd-8a23-a2c580b2e563 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.097905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919a379-7adc-41dd-8a23-a2c580b2e563 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.103064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abf12f-1436-4ae3-b7bb-bfee5b0a2a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.103679 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abf12f-1436-4ae3-b7bb-bfee5b0a2a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.103963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abf12f-1436-4ae3-b7bb-bfee5b0a2a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.104238 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abf12f-1436-4ae3-b7bb-bfee5b0a2a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.104931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abf12f-1436-4ae3-b7bb-bfee5b0a2a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.106117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:24.106586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abf12f-1436-4ae3-b7bb-bfee5b0a2a1a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.118887 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1334/2639] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:24.122884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abf12f-1436-4ae3-b7bb-bfee5b0a2a1a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.125074 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.126631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.135700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abf12f-1436-4ae3-b7bb-bfee5b0a2a1a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.137031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1306/2640] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:23 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:24.140825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addc68e-ba6e-45fb-9313-fc119c389984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.141533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc68e-ba6e-45fb-9313-fc119c389984 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.142292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc68e-ba6e-45fb-9313-fc119c389984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.142770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc68e-ba6e-45fb-9313-fc119c389984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.143329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addc68e-ba6e-45fb-9313-fc119c389984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.144950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addc68e-ba6e-45fb-9313-fc119c389984 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.162534 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1335/2641] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:24.163330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.175439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f8e2e-acf8-46cb-81ae-581d6c13f28a service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.180805 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29faf-aded-401c-88eb-bd0babf72717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.181890 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29faf-aded-401c-88eb-bd0babf72717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.182176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29faf-aded-401c-88eb-bd0babf72717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.182452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29faf-aded-401c-88eb-bd0babf72717 admin admin] PATH_INFO: `/v3/projects/105e64f9a013419ca1959581a6abf7d1/users/898455d696c942f196d06b180b830a20/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.202944 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29faf-aded-401c-88eb-bd0babf72717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105e64f9a013419ca1959581a6abf7d1, user_id=898455d696c942f196d06b180b830a20, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.206007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29faf-aded-401c-88eb-bd0babf72717 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.223233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1307/2642] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:24 2022] PUT /identity/v3/projects/105e64f9a013419ca1959581a6abf7d1/users/898455d696c942f196d06b180b830a20/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:24.237019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81821b8-a7e8-49b5-a3d4-b2394cfade85 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.237019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81821b8-a7e8-49b5-a3d4-b2394cfade85 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.237361 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81821b8-a7e8-49b5-a3d4-b2394cfade85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.267724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c81821b8-a7e8-49b5-a3d4-b2394cfade85 None None] MFA Rules not processed for user `898455d696c942f196d06b180b830a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:24.269561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c81821b8-a7e8-49b5-a3d4-b2394cfade85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:24.364763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1336/2643] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:24.369095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29faf-aded-401c-88eb-bd0babf72717 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.456752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29faf-aded-401c-88eb-bd0babf72717 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.467731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881bc16-9058-4e7e-9d64-81a79ada02df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.468644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881bc16-9058-4e7e-9d64-81a79ada02df admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.469024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881bc16-9058-4e7e-9d64-81a79ada02df admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.469435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881bc16-9058-4e7e-9d64-81a79ada02df admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.471263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881bc16-9058-4e7e-9d64-81a79ada02df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.473892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881bc16-9058-4e7e-9d64-81a79ada02df admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.509523 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1308/2644] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:24 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:24.514294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81821b8-a7e8-49b5-a3d4-b2394cfade85 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.528333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81821b8-a7e8-49b5-a3d4-b2394cfade85 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.580770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:24.604154 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142f1fc-d049-464d-9fe6-65399ace1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.605125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f1fc-d049-464d-9fe6-65399ace1fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.605469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f1fc-d049-464d-9fe6-65399ace1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.605831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f1fc-d049-464d-9fe6-65399ace1fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.606618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142f1fc-d049-464d-9fe6-65399ace1fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.608702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142f1fc-d049-464d-9fe6-65399ace1fa4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.639327 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1337/2645] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:24 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:24.645661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881bc16-9058-4e7e-9d64-81a79ada02df admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.659277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881bc16-9058-4e7e-9d64-81a79ada02df admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.664875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6329dc-1eba-4f4d-b576-284f0d4d96e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.665349 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6329dc-1eba-4f4d-b576-284f0d4d96e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.665644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6329dc-1eba-4f4d-b576-284f0d4d96e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.665962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6329dc-1eba-4f4d-b576-284f0d4d96e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.666700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6329dc-1eba-4f4d-b576-284f0d4d96e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.668330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6329dc-1eba-4f4d-b576-284f0d4d96e0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.679889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1309/2646] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:24.684165 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142f1fc-d049-464d-9fe6-65399ace1fa4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.695176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142f1fc-d049-464d-9fe6-65399ace1fa4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.702381 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebcaaa-1010-42df-9e4a-326dc54e66bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.703040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcaaa-1010-42df-9e4a-326dc54e66bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.703313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcaaa-1010-42df-9e4a-326dc54e66bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.703610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcaaa-1010-42df-9e4a-326dc54e66bc admin admin] PATH_INFO: `/v3/projects/aa124d0eae534c459eb239fd6c61b89f/users/bbab9ea3f9d24ab5836413fc350015dc/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.725672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebcaaa-1010-42df-9e4a-326dc54e66bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa124d0eae534c459eb239fd6c61b89f, user_id=bbab9ea3f9d24ab5836413fc350015dc, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.728553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebcaaa-1010-42df-9e4a-326dc54e66bc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.751377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1338/2647] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:24 2022] PUT /identity/v3/projects/aa124d0eae534c459eb239fd6c61b89f/users/bbab9ea3f9d24ab5836413fc350015dc/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:24.756094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6329dc-1eba-4f4d-b576-284f0d4d96e0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.770265 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6329dc-1eba-4f4d-b576-284f0d4d96e0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.837936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62daa7-c36c-4784-a88f-733fb144267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.838856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62daa7-c36c-4784-a88f-733fb144267d admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.839287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62daa7-c36c-4784-a88f-733fb144267d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.839672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62daa7-c36c-4784-a88f-733fb144267d admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.840777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62daa7-c36c-4784-a88f-733fb144267d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.843038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62daa7-c36c-4784-a88f-733fb144267d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.856447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1310/2648] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:24.860756 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebcaaa-1010-42df-9e4a-326dc54e66bc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:24.872054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebcaaa-1010-42df-9e4a-326dc54e66bc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:24.878271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bcfe4-3101-462c-8941-a00294e77e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:24.878585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcfe4-3101-462c-8941-a00294e77e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.878795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcfe4-3101-462c-8941-a00294e77e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.879118 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcfe4-3101-462c-8941-a00294e77e78 admin admin] PATH_INFO: `/v3/projects/aa124d0eae534c459eb239fd6c61b89f/users/bbab9ea3f9d24ab5836413fc350015dc/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.881417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bcfe4-3101-462c-8941-a00294e77e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa124d0eae534c459eb239fd6c61b89f, user_id=bbab9ea3f9d24ab5836413fc350015dc, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:24.884229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bcfe4-3101-462c-8941-a00294e77e78 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:24.909631 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1339/2649] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:24 2022] PUT /identity/v3/projects/aa124d0eae534c459eb239fd6c61b89f/users/bbab9ea3f9d24ab5836413fc350015dc/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:24.914469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e758bb-0f2e-44e8-8383-0e19cfd082a1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:24.914786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e758bb-0f2e-44e8-8383-0e19cfd082a1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:24.915039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e758bb-0f2e-44e8-8383-0e19cfd082a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:24.946989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-47e758bb-0f2e-44e8-8383-0e19cfd082a1 None None] MFA Rules not processed for user `bbab9ea3f9d24ab5836413fc350015dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:24.948530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-47e758bb-0f2e-44e8-8383-0e19cfd082a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:24.986566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:25.038015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1311/2650] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:25.048452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bcfe4-3101-462c-8941-a00294e77e78 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:25.113979 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bcfe4-3101-462c-8941-a00294e77e78 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:25.118779 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceef534-325d-40bc-b437-2ee96e81a263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:25.119340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceef534-325d-40bc-b437-2ee96e81a263 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:25.119618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceef534-325d-40bc-b437-2ee96e81a263 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:25.119888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceef534-325d-40bc-b437-2ee96e81a263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:25.130699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceef534-325d-40bc-b437-2ee96e81a263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:25.132207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceef534-325d-40bc-b437-2ee96e81a263 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:25.147001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1340/2651] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:25.650334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e758bb-0f2e-44e8-8383-0e19cfd082a1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:25.737694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e758bb-0f2e-44e8-8383-0e19cfd082a1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:25.746228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:25.747506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:25.748177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:25.748522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] PATH_INFO: `/v3/users/898455d696c942f196d06b180b830a20` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:25.750882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=898455d696c942f196d06b180b830a20)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:25.753421 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:25.817829 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898455d696c942f196d06b180b830a20'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:25.831888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898455d696c942f196d06b180b830a20'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:25.832897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898455d696c942f196d06b180b830a20'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:25.833494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898455d696c942f196d06b180b830a20'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:25.846247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898455d696c942f196d06b180b830a20'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:25.869899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1312/2652] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:25 2022] DELETE /identity/v3/users/898455d696c942f196d06b180b830a20 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:25.874046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541977-48f4-45eb-a897-328c11fa8ae8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:25.874595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541977-48f4-45eb-a897-328c11fa8ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:25.874595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541977-48f4-45eb-a897-328c11fa8ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:25.899572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e0541977-48f4-45eb-a897-328c11fa8ae8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:25.900955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e0541977-48f4-45eb-a897-328c11fa8ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:25.995521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1341/2653] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:26.022767 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:26.025011 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:26.110370 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:26.124536 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a30cb-cb57-485a-8c5e-dca5c721f628 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:26.129587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f0d1e-3f85-476b-9b6e-a8ff712386cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:26.130308 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f0d1e-3f85-476b-9b6e-a8ff712386cf service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:26.131428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f0d1e-3f85-476b-9b6e-a8ff712386cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:26.131613 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f0d1e-3f85-476b-9b6e-a8ff712386cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:26.145631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f0d1e-3f85-476b-9b6e-a8ff712386cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:26.147201 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f0d1e-3f85-476b-9b6e-a8ff712386cf service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:26.158024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1313/2654] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:26.709012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0541977-48f4-45eb-a897-328c11fa8ae8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:26.710985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e0541977-48f4-45eb-a897-328c11fa8ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:26.726789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0541977-48f4-45eb-a897-328c11fa8ae8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:26.736027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:26.738720 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:26.739594 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:26.740318 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] PATH_INFO: `/v3/projects/105e64f9a013419ca1959581a6abf7d1` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:26.742201 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=105e64f9a013419ca1959581a6abf7d1)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:26.745986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:26.794040 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:26.810151 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105e64f9a013419ca1959581a6abf7d1', 'request_id': 'req-290c6603-1c16-4f3d-b99e-50f24db235bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:26.828721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105e64f9a013419ca1959581a6abf7d1', 'request_id': 'req-290c6603-1c16-4f3d-b99e-50f24db235bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:26.836653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105e64f9a013419ca1959581a6abf7d1', 'request_id': 'req-290c6603-1c16-4f3d-b99e-50f24db235bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:26.851145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] The token cache is being invalidate because project 105e64f9a013419ca1959581a6abf7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:26.851500 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:26.852337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:26.854297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1342/2655] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:26 2022] DELETE /identity/v3/projects/105e64f9a013419ca1959581a6abf7d1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:26.858567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f0d1e-3f85-476b-9b6e-a8ff712386cf service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:26.873582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f0d1e-3f85-476b-9b6e-a8ff712386cf service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:26.979755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:26.980574 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:26.981005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:26.981259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] PATH_INFO: `/v3/users/bbab9ea3f9d24ab5836413fc350015dc` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:26.982638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbab9ea3f9d24ab5836413fc350015dc)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:26.984713 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:27.075324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbab9ea3f9d24ab5836413fc350015dc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.090900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbab9ea3f9d24ab5836413fc350015dc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.091570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbab9ea3f9d24ab5836413fc350015dc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.092736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbab9ea3f9d24ab5836413fc350015dc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.109338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbab9ea3f9d24ab5836413fc350015dc'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.153368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1314/2656] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:26 2022] DELETE /identity/v3/users/bbab9ea3f9d24ab5836413fc350015dc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:27.440672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:27.442609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:27.472082 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c6603-1c16-4f3d-b99e-50f24db235bd admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:27.586144 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:27.587123 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:27.587400 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:27.588247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] PATH_INFO: `/v3/users/452b906a5338428d8fc824ddff2093e8` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:27.593024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452b906a5338428d8fc824ddff2093e8)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:27.598592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:27.648482 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:27.650071 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:27.684012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8758-dc81-49c7-b1cc-4e4fc6c1c95c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:27.689001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452b906a5338428d8fc824ddff2093e8'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.693682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:27.694811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:27.695484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:27.697063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] PATH_INFO: `/v3/projects/aa124d0eae534c459eb239fd6c61b89f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:27.699027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa124d0eae534c459eb239fd6c61b89f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:27.702809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:27.708225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452b906a5338428d8fc824ddff2093e8'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.720219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452b906a5338428d8fc824ddff2093e8'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.721391 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452b906a5338428d8fc824ddff2093e8'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.722723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a0adbdd5-568a-451d-ac00-fca824bfff46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452b906a5338428d8fc824ddff2093e8'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.743872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1343/2657] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:27 2022] DELETE /identity/v3/users/452b906a5338428d8fc824ddff2093e8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:27.813592 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa124d0eae534c459eb239fd6c61b89f', 'request_id': 'req-94f1d99d-1b59-458e-9442-12a1eb9d73e9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.823086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa124d0eae534c459eb239fd6c61b89f', 'request_id': 'req-94f1d99d-1b59-458e-9442-12a1eb9d73e9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.835989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa124d0eae534c459eb239fd6c61b89f', 'request_id': 'req-94f1d99d-1b59-458e-9442-12a1eb9d73e9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.839221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:27.853343 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] The token cache is being invalidate because project aa124d0eae534c459eb239fd6c61b89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:27.854522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.855428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:27.857714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1315/2658] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:27 2022] DELETE /identity/v3/projects/aa124d0eae534c459eb239fd6c61b89f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:27.862442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38c49-9b89-464f-977b-9bd76ebea3a6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:27.862718 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38c49-9b89-464f-977b-9bd76ebea3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:27.862991 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38c49-9b89-464f-977b-9bd76ebea3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:27.885365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f4d38c49-9b89-464f-977b-9bd76ebea3a6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:27.886617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f4d38c49-9b89-464f-977b-9bd76ebea3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:27.959330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:27.975645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:27.977533 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.022196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1344/2659] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:28.034172 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ffda-a493-43fb-bd4c-c0b5723564d4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.034768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ffda-a493-43fb-bd4c-c0b5723564d4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.035308 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ffda-a493-43fb-bd4c-c0b5723564d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.062811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f2f3ffda-a493-43fb-bd4c-c0b5723564d4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:28.065461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f2f3ffda-a493-43fb-bd4c-c0b5723564d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.078437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1345/2660] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:28.080186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3ffda-a493-43fb-bd4c-c0b5723564d4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.083095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1d99d-1b59-458e-9442-12a1eb9d73e9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.088409 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.089714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.089997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.090272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] PATH_INFO: `/v3/projects/4a3e1ffdc05e471ab0daeb978e81e291` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.092246 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3e1ffdc05e471ab0daeb978e81e291)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.094350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.096420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3ffda-a493-43fb-bd4c-c0b5723564d4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.106215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.107021 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.107378 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.107630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.108280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:28.108617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.110941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.128424 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1346/2661] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:39:28.133322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.147488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d27f4-dc61-48d3-8774-e338d0e0f992 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.154865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719dd0e-510a-45ab-ab73-829c257046be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.155739 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719dd0e-510a-45ab-ab73-829c257046be admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.156149 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719dd0e-510a-45ab-ab73-829c257046be admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.156591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719dd0e-510a-45ab-ab73-829c257046be admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.157595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719dd0e-510a-45ab-ab73-829c257046be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.160704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719dd0e-510a-45ab-ab73-829c257046be admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.169065 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3e1ffdc05e471ab0daeb978e81e291', 'request_id': 'req-6f6f0960-1780-4ee0-8b53-3f7112225e7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:28.182247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3e1ffdc05e471ab0daeb978e81e291', 'request_id': 'req-6f6f0960-1780-4ee0-8b53-3f7112225e7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:28.193447 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3e1ffdc05e471ab0daeb978e81e291', 'request_id': 'req-6f6f0960-1780-4ee0-8b53-3f7112225e7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:28.196232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1347/2662] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:28.200468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719dd0e-510a-45ab-ab73-829c257046be admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.207124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] The token cache is being invalidate because project 4a3e1ffdc05e471ab0daeb978e81e291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:28.207422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:28.208597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6f6f0960-1780-4ee0-8b53-3f7112225e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:28.210665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1316/2663] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:27 2022] DELETE /identity/v3/projects/4a3e1ffdc05e471ab0daeb978e81e291 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:28.215626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fbf1-6f3d-47c9-9a1e-5953a35178ca None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.215904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fbf1-6f3d-47c9-9a1e-5953a35178ca None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.216176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61fbf1-6f3d-47c9-9a1e-5953a35178ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.240427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5e61fbf1-6f3d-47c9-9a1e-5953a35178ca None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:28.241711 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5e61fbf1-6f3d-47c9-9a1e-5953a35178ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.274414 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719dd0e-510a-45ab-ab73-829c257046be admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.279517 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.280134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.280443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.280723 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.281367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.283582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.308333 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1348/2664] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:28.309488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1317/2665] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:28.312746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.315002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.318985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2065c-f15f-4a47-87a7-9b90fef19e24 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.319316 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2065c-f15f-4a47-87a7-9b90fef19e24 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.319675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2065c-f15f-4a47-87a7-9b90fef19e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.328052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7bc7d-bd3d-4d85-a992-b5b737a19fd5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.333112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5cc5f-4126-4dd8-a2ad-81093d73f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.333738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5cc5f-4126-4dd8-a2ad-81093d73f9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.334014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5cc5f-4126-4dd8-a2ad-81093d73f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.334286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5cc5f-4126-4dd8-a2ad-81093d73f9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.334942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5cc5f-4126-4dd8-a2ad-81093d73f9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.336607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5cc5f-4126-4dd8-a2ad-81093d73f9a1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.340846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f9a2065c-f15f-4a47-87a7-9b90fef19e24 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:28.342060 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f9a2065c-f15f-4a47-87a7-9b90fef19e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.347856 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1349/2666] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:28.350113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1318/2667] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:28.352024 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5cc5f-4126-4dd8-a2ad-81093d73f9a1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.354314 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2065c-f15f-4a47-87a7-9b90fef19e24 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.362628 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5cc5f-4126-4dd8-a2ad-81093d73f9a1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.363629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2065c-f15f-4a47-87a7-9b90fef19e24 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.367516 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee8cd4-4cc6-4faf-b2fd-5de620ff85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.368122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8cd4-4cc6-4faf-b2fd-5de620ff85e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.368422 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8cd4-4cc6-4faf-b2fd-5de620ff85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.368698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8cd4-4cc6-4faf-b2fd-5de620ff85e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.368806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.369335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee8cd4-4cc6-4faf-b2fd-5de620ff85e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.369537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.369884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.370225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.370941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee8cd4-4cc6-4faf-b2fd-5de620ff85e3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.371039 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:28.371396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.373469 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.382243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1350/2668] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:28.387673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:28.387673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1319/2669] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:28.387952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee8cd4-4cc6-4faf-b2fd-5de620ff85e3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.390690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.401293 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee8cd4-4cc6-4faf-b2fd-5de620ff85e3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.402439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660eecc-cf4f-4475-9c6f-cc272930c96e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.406092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6459f11-b191-4002-a115-738a1865aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.406799 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6459f11-b191-4002-a115-738a1865aeff admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.407086 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6459f11-b191-4002-a115-738a1865aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.407377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6459f11-b191-4002-a115-738a1865aeff admin admin] PATH_INFO: `/v3/projects/5c5cf7130d804010b29e97d0a608dc2d/users/8503300ce3984b65a431e9cca985e6d2/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.408373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b005f4-d23d-44ca-b5cc-8f6140adb2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.409100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b005f4-d23d-44ca-b5cc-8f6140adb2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.409529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b005f4-d23d-44ca-b5cc-8f6140adb2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.409856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b005f4-d23d-44ca-b5cc-8f6140adb2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.410510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b005f4-d23d-44ca-b5cc-8f6140adb2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.412538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b005f4-d23d-44ca-b5cc-8f6140adb2d4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.422849 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6459f11-b191-4002-a115-738a1865aeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5cf7130d804010b29e97d0a608dc2d, user_id=8503300ce3984b65a431e9cca985e6d2, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.425907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6459f11-b191-4002-a115-738a1865aeff admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.443156 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1351/2670] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:28 2022] PUT /identity/v3/projects/5c5cf7130d804010b29e97d0a608dc2d/users/8503300ce3984b65a431e9cca985e6d2/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:28.447702 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1320/2671] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:28.448910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6459f11-b191-4002-a115-738a1865aeff admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.460847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7b048-942e-4854-8145-5cbb74b886b8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.461116 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7b048-942e-4854-8145-5cbb74b886b8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.461391 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7b048-942e-4854-8145-5cbb74b886b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.492200 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-90e7b048-942e-4854-8145-5cbb74b886b8 None None] MFA Rules not processed for user `8503300ce3984b65a431e9cca985e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:28.493485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-90e7b048-942e-4854-8145-5cbb74b886b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.502509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:28.525215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6459f11-b191-4002-a115-738a1865aeff admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.582238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1321/2672] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:28.594712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7b048-942e-4854-8145-5cbb74b886b8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.597487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-90e7b048-942e-4854-8145-5cbb74b886b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.603116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b33aa8-a542-4bc2-ab44-079b0033203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.603836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b33aa8-a542-4bc2-ab44-079b0033203f admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.604083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b33aa8-a542-4bc2-ab44-079b0033203f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.604358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b33aa8-a542-4bc2-ab44-079b0033203f admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.605064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b33aa8-a542-4bc2-ab44-079b0033203f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.607097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b33aa8-a542-4bc2-ab44-079b0033203f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.636105 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1352/2673] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:28.642315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b33aa8-a542-4bc2-ab44-079b0033203f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.657676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b33aa8-a542-4bc2-ab44-079b0033203f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.666084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b4fd-be46-45f1-877b-c6a113c1c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.667126 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b4fd-be46-45f1-877b-c6a113c1c374 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.667656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b4fd-be46-45f1-877b-c6a113c1c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.668112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b4fd-be46-45f1-877b-c6a113c1c374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.669213 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b4fd-be46-45f1-877b-c6a113c1c374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.672231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b4fd-be46-45f1-877b-c6a113c1c374 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.679777 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7b048-942e-4854-8145-5cbb74b886b8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.685684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd313f-08fb-4269-a5da-596c746f5794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.686312 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd313f-08fb-4269-a5da-596c746f5794 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.686591 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd313f-08fb-4269-a5da-596c746f5794 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.686877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd313f-08fb-4269-a5da-596c746f5794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.692636 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1353/2674] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:28.697446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b4fd-be46-45f1-877b-c6a113c1c374 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.700498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd313f-08fb-4269-a5da-596c746f5794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.703146 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd313f-08fb-4269-a5da-596c746f5794 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.717648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b4fd-be46-45f1-877b-c6a113c1c374 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.723306 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1322/2675] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:28.727314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.728107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.728448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.728726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.729349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.731142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.745784 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1354/2676] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:28.750232 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd313f-08fb-4269-a5da-596c746f5794 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.765285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd313f-08fb-4269-a5da-596c746f5794 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.772246 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52ad80-1366-451f-a5f3-e7abf550c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.773073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ad80-1366-451f-a5f3-e7abf550c72c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.773419 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ad80-1366-451f-a5f3-e7abf550c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.773760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ad80-1366-451f-a5f3-e7abf550c72c admin admin] PATH_INFO: `/v3/projects/c385ffa71fab4718828fff8883d64eed/users/dd4fcbe2bdf14de1a963d0f44d931124/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.796319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:28.798261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.801996 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52ad80-1366-451f-a5f3-e7abf550c72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c385ffa71fab4718828fff8883d64eed, user_id=dd4fcbe2bdf14de1a963d0f44d931124, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.807141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52ad80-1366-451f-a5f3-e7abf550c72c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.814022 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f8c6-be8f-492d-816c-0584abeb908b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:28.821561 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:28.822914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.823487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.823859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] PATH_INFO: `/v3/users/38a9bcc2014c4f2390378339d25ac2fe` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.825420 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a9bcc2014c4f2390378339d25ac2fe)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:28.826137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1323/2677] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:28 2022] PUT /identity/v3/projects/c385ffa71fab4718828fff8883d64eed/users/dd4fcbe2bdf14de1a963d0f44d931124/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:28.828296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:28.837384 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb21f5c-b941-49d7-80c9-48b885b2f8ce None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:28.837682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb21f5c-b941-49d7-80c9-48b885b2f8ce None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:28.838336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb21f5c-b941-49d7-80c9-48b885b2f8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:28.891997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2fb21f5c-b941-49d7-80c9-48b885b2f8ce None None] MFA Rules not processed for user `dd4fcbe2bdf14de1a963d0f44d931124`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:28.894217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2fb21f5c-b941-49d7-80c9-48b885b2f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:28.943501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a9bcc2014c4f2390378339d25ac2fe'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:28.951721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:28.985521 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a9bcc2014c4f2390378339d25ac2fe'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.003460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a9bcc2014c4f2390378339d25ac2fe'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.004418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a9bcc2014c4f2390378339d25ac2fe'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.005205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-bb351879-6355-4ef0-b2c3-a20e6fe76ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a9bcc2014c4f2390378339d25ac2fe'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.015041 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1324/2678] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:29.027466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb21f5c-b941-49d7-80c9-48b885b2f8ce None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:29.030014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2fb21f5c-b941-49d7-80c9-48b885b2f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:29.035005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1355/2679] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:28 2022] DELETE /identity/v3/users/38a9bcc2014c4f2390378339d25ac2fe => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:29.041191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5ea42-f53f-403b-b767-093631e887d7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:29.041678 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5ea42-f53f-403b-b767-093631e887d7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:29.042674 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5ea42-f53f-403b-b767-093631e887d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:29.086114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dff5ea42-f53f-403b-b767-093631e887d7 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:29.088205 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dff5ea42-f53f-403b-b767-093631e887d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:29.117262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:29.163889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb21f5c-b941-49d7-80c9-48b885b2f8ce None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:29.179929 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1356/2680] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:29.186265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5ea42-f53f-403b-b767-093631e887d7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:29.187874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dff5ea42-f53f-403b-b767-093631e887d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:29.253489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:29.254247 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:29.254587 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:29.254876 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:29.256646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:29.260592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5ea42-f53f-403b-b767-093631e887d7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:29.266054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:29.266970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:29.267699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:29.268873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:29.279240 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:29.280802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:29.293645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1357/2681] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:29.321823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:29.323439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:29.333717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1325/2682] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:29.652063 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:29.657367 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:29.680910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483494cd-1ffa-4c59-9c09-8c13fb7750bc service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:29.691377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:29.693124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:29.693686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:29.694352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] PATH_INFO: `/v3/projects/a29777bdad46410b9d8b4cb79069c128` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:29.698083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29777bdad46410b9d8b4cb79069c128)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:29.704645 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:29.795292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29777bdad46410b9d8b4cb79069c128', 'request_id': 'req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.807562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29777bdad46410b9d8b4cb79069c128', 'request_id': 'req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.819193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29777bdad46410b9d8b4cb79069c128', 'request_id': 'req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.842046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] The token cache is being invalidate because project a29777bdad46410b9d8b4cb79069c128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:29.842337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.843456 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.845510 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1358/2683] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:29 2022] DELETE /identity/v3/projects/a29777bdad46410b9d8b4cb79069c128 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:29.849688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:29.860998 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4817054-2096-45a7-b1bd-0c297046e33e service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:29.869989 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:29.922812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:29.923453 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:29.923734 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:29.924006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] PATH_INFO: `/v3/users/f453e1ba3e8e442681a8ccbf023c042b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:29.925289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f453e1ba3e8e442681a8ccbf023c042b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:29.927297 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:29.985288 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f453e1ba3e8e442681a8ccbf023c042b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.993457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f453e1ba3e8e442681a8ccbf023c042b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.994100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f453e1ba3e8e442681a8ccbf023c042b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:29.994721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f453e1ba3e8e442681a8ccbf023c042b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:30.002856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-91d26e02-fac5-4e6c-a3c9-e570e129ecd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f453e1ba3e8e442681a8ccbf023c042b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:30.021709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1326/2684] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:29 2022] DELETE /identity/v3/users/f453e1ba3e8e442681a8ccbf023c042b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:30.384272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:30.387117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:30.421438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1fe0-ad4b-4065-a25c-ebe7a45033ef admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:30.519262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:30.529485 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:30.535522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:30.536307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:30.536778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] PATH_INFO: `/v3/projects/ecd02be56d804eb7a71ec47c1ba6bdde` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:30.538984 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd02be56d804eb7a71ec47c1ba6bdde)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:30.542012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:30.628550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd02be56d804eb7a71ec47c1ba6bdde', 'request_id': 'req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:30.642901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd02be56d804eb7a71ec47c1ba6bdde', 'request_id': 'req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:30.655609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd02be56d804eb7a71ec47c1ba6bdde', 'request_id': 'req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:30.677752 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] The token cache is being invalidate because project ecd02be56d804eb7a71ec47c1ba6bdde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:30.678575 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:30.679939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2fb0cfc-61fb-4ca4-8ba0-79be955a24dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:30.688699 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1359/2685] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:30 2022] DELETE /identity/v3/projects/ecd02be56d804eb7a71ec47c1ba6bdde => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:30.689323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31032c48-2565-40bb-88ad-eaa29f2e56f9 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:30.689722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31032c48-2565-40bb-88ad-eaa29f2e56f9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:30.690073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31032c48-2565-40bb-88ad-eaa29f2e56f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:30.712237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-31032c48-2565-40bb-88ad-eaa29f2e56f9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:30.713629 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-31032c48-2565-40bb-88ad-eaa29f2e56f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:30.800790 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1327/2686] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:30.808874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503851d7-8196-429c-bf26-d4a085b67794 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:30.809197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503851d7-8196-429c-bf26-d4a085b67794 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:30.809496 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503851d7-8196-429c-bf26-d4a085b67794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:30.837978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-503851d7-8196-429c-bf26-d4a085b67794 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:30.839814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-503851d7-8196-429c-bf26-d4a085b67794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:30.855581 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1360/2687] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:30.856514 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31032c48-2565-40bb-88ad-eaa29f2e56f9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:30.868286 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31032c48-2565-40bb-88ad-eaa29f2e56f9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:30.875513 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:30.876564 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:30.877107 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:30.877656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:30.881238 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:30.881660 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:30.883606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:30.904169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1328/2688] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:30.905931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503851d7-8196-429c-bf26-d4a085b67794 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:30.921169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503851d7-8196-429c-bf26-d4a085b67794 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:30.930202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205385b1-e061-4679-8493-0273676c0095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:30.930820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205385b1-e061-4679-8493-0273676c0095 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:30.931185 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205385b1-e061-4679-8493-0273676c0095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:30.931431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205385b1-e061-4679-8493-0273676c0095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:30.932085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205385b1-e061-4679-8493-0273676c0095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:30.934007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205385b1-e061-4679-8493-0273676c0095 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:30.972584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1361/2689] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:30 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:30.979918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:30.991101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c3fb8-10c6-42a7-bd20-4307aeddf644 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:31.006984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:31.063893 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169c0de-f1e1-4c2d-8cae-d9495156636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:31.064630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c0de-f1e1-4c2d-8cae-d9495156636e admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:31.064630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c0de-f1e1-4c2d-8cae-d9495156636e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:31.064851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c0de-f1e1-4c2d-8cae-d9495156636e admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:31.065603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169c0de-f1e1-4c2d-8cae-d9495156636e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:31.067388 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169c0de-f1e1-4c2d-8cae-d9495156636e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:31.097633 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1329/2690] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:30 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:31.099177 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205385b1-e061-4679-8493-0273676c0095 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:31.114044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205385b1-e061-4679-8493-0273676c0095 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:31.119895 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aec97-ae32-4f53-9c9d-d7121ec1d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:31.120606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aec97-ae32-4f53-9c9d-d7121ec1d875 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:31.121044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aec97-ae32-4f53-9c9d-d7121ec1d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:31.121401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aec97-ae32-4f53-9c9d-d7121ec1d875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:31.122057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04aec97-ae32-4f53-9c9d-d7121ec1d875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:31.123671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04aec97-ae32-4f53-9c9d-d7121ec1d875 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:31.144250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169c0de-f1e1-4c2d-8cae-d9495156636e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:31.144609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1362/2691] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:31.164019 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169c0de-f1e1-4c2d-8cae-d9495156636e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:31.169212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7a107-1d48-4526-aa9a-3434672640cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:31.169841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7a107-1d48-4526-aa9a-3434672640cf admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:31.170124 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7a107-1d48-4526-aa9a-3434672640cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:31.170397 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7a107-1d48-4526-aa9a-3434672640cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:31.171055 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7a107-1d48-4526-aa9a-3434672640cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:31.173789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7a107-1d48-4526-aa9a-3434672640cf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:31.185361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1330/2692] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:31.189955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aec97-ae32-4f53-9c9d-d7121ec1d875 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:31.201302 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aec97-ae32-4f53-9c9d-d7121ec1d875 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:31.206075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:31.206827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:31.207181 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:31.207509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] PATH_INFO: `/v3/projects/751d3d49ef5640fab1efd0a213d2713a/users/ba09f1bf62e540b0906c0060c0547029/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:31.224474 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=751d3d49ef5640fab1efd0a213d2713a, user_id=ba09f1bf62e540b0906c0060c0547029, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:31.227515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:31.242868 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1363/2693] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:31 2022] PUT /identity/v3/projects/751d3d49ef5640fab1efd0a213d2713a/users/ba09f1bf62e540b0906c0060c0547029/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:31.320541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c00003-14ff-44ce-bffc-6ecb52c37639 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:31.320846 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c00003-14ff-44ce-bffc-6ecb52c37639 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:31.321132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c00003-14ff-44ce-bffc-6ecb52c37639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:31.353698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b8c00003-14ff-44ce-bffc-6ecb52c37639 None None] MFA Rules not processed for user `ba09f1bf62e540b0906c0060c0547029`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:31.354964 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b8c00003-14ff-44ce-bffc-6ecb52c37639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:31.452208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1331/2694] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:31.464815 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:31.467223 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:31.533198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63cdbf-eb35-47ce-a421-656cd94f7836 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:31.537317 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b782e-0672-4682-9453-945e3b5e18a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:31.537940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b782e-0672-4682-9453-945e3b5e18a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:31.538183 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b782e-0672-4682-9453-945e3b5e18a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:31.538472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b782e-0672-4682-9453-945e3b5e18a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:31.548005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b782e-0672-4682-9453-945e3b5e18a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:31.549491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b782e-0672-4682-9453-945e3b5e18a6 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:31.558869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1364/2695] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:32.185912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c00003-14ff-44ce-bffc-6ecb52c37639 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:32.187545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b8c00003-14ff-44ce-bffc-6ecb52c37639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:32.264158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c00003-14ff-44ce-bffc-6ecb52c37639 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:32.268832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:32.269493 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:32.269907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:32.270012 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] PATH_INFO: `/v3/users/8503300ce3984b65a431e9cca985e6d2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:32.271390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8503300ce3984b65a431e9cca985e6d2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:32.273253 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:32.308851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:32.336439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8503300ce3984b65a431e9cca985e6d2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:32.351415 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8503300ce3984b65a431e9cca985e6d2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:32.352127 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8503300ce3984b65a431e9cca985e6d2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:32.352853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8503300ce3984b65a431e9cca985e6d2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:32.362928 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8503300ce3984b65a431e9cca985e6d2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:32.387539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1332/2696] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:32 2022] DELETE /identity/v3/users/8503300ce3984b65a431e9cca985e6d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:32.392788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08511b6-a52b-4b89-a720-5d62fe61095d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:32.393528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08511b6-a52b-4b89-a720-5d62fe61095d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:32.393528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08511b6-a52b-4b89-a720-5d62fe61095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:32.422821 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e08511b6-a52b-4b89-a720-5d62fe61095d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:32.424490 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e08511b6-a52b-4b89-a720-5d62fe61095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:32.455941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:32.541468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1365/2697] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:32.545526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:32.547927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:32.630990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388b4e-8d47-40dd-b615-5a293b2a9772 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:32.635063 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c7699-0240-43fc-b32b-d96119289e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:32.635675 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7699-0240-43fc-b32b-d96119289e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:32.635959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7699-0240-43fc-b32b-d96119289e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:32.636239 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7699-0240-43fc-b32b-d96119289e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:32.651796 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c7699-0240-43fc-b32b-d96119289e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:32.653809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c7699-0240-43fc-b32b-d96119289e73 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:32.666722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1333/2698] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:33.376247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08511b6-a52b-4b89-a720-5d62fe61095d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:33.379405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e08511b6-a52b-4b89-a720-5d62fe61095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:33.400121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08511b6-a52b-4b89-a720-5d62fe61095d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:33.409470 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:33.410340 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:33.411394 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:33.411770 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] PATH_INFO: `/v3/projects/5c5cf7130d804010b29e97d0a608dc2d` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:33.413570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5cf7130d804010b29e97d0a608dc2d)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:33.415570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:33.495190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5cf7130d804010b29e97d0a608dc2d', 'request_id': 'req-53e264b4-40c0-4dff-8820-4a934c7029db'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:33.506405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5cf7130d804010b29e97d0a608dc2d', 'request_id': 'req-53e264b4-40c0-4dff-8820-4a934c7029db'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:33.514058 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5cf7130d804010b29e97d0a608dc2d', 'request_id': 'req-53e264b4-40c0-4dff-8820-4a934c7029db'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:33.529762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] The token cache is being invalidate because project 5c5cf7130d804010b29e97d0a608dc2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:33.530087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:33.531542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-53e264b4-40c0-4dff-8820-4a934c7029db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:33.534246 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1366/2699] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:33 2022] DELETE /identity/v3/projects/5c5cf7130d804010b29e97d0a608dc2d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:33.543436 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7caa58-706a-48c2-a0af-ebb3da11ce98 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:33.546440 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7caa58-706a-48c2-a0af-ebb3da11ce98 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:33.547031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7caa58-706a-48c2-a0af-ebb3da11ce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:33.581616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ca7caa58-706a-48c2-a0af-ebb3da11ce98 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:33.587281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ca7caa58-706a-48c2-a0af-ebb3da11ce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:33.687724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1334/2700] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:33.700225 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086e3c-f937-4f96-ac28-dcaaedd945dc None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:33.700952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086e3c-f937-4f96-ac28-dcaaedd945dc None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:33.701260 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086e3c-f937-4f96-ac28-dcaaedd945dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:33.742809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-df086e3c-f937-4f96-ac28-dcaaedd945dc None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:33.744808 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-df086e3c-f937-4f96-ac28-dcaaedd945dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:33.761141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1367/2701] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:33.767345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7caa58-706a-48c2-a0af-ebb3da11ce98 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:33.783958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7caa58-706a-48c2-a0af-ebb3da11ce98 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:33.789733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:33.790372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:33.790909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:33.791172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:33.792001 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:33.792526 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:33.794126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:33.806746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1335/2702] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:33.811498 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df086e3c-f937-4f96-ac28-dcaaedd945dc None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:33.823194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df086e3c-f937-4f96-ac28-dcaaedd945dc None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:33.828726 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fabe2-a686-4272-9903-a98852648b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:33.829588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fabe2-a686-4272-9903-a98852648b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:33.829812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fabe2-a686-4272-9903-a98852648b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:33.830075 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fabe2-a686-4272-9903-a98852648b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:33.830764 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fabe2-a686-4272-9903-a98852648b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:33.832900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fabe2-a686-4272-9903-a98852648b60 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:33.878644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1368/2703] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:33 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:33.885678 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:33.903857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faadc28-01a0-4f55-be78-45a2b51ab5ea admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:33.946542 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:33.984245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ce24-aab7-492d-9c78-6320b04ff517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:33.985801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ce24-aab7-492d-9c78-6320b04ff517 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:33.986097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ce24-aab7-492d-9c78-6320b04ff517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:33.986379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ce24-aab7-492d-9c78-6320b04ff517 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:33.987031 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09ce24-aab7-492d-9c78-6320b04ff517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:33.989225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09ce24-aab7-492d-9c78-6320b04ff517 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.022301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1336/2704] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:33 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:34.026659 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fabe2-a686-4272-9903-a98852648b60 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.040742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fabe2-a686-4272-9903-a98852648b60 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:34.053621 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575126d1-4ad7-4c21-b3ae-2e1f2f56b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:34.053876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575126d1-4ad7-4c21-b3ae-2e1f2f56b275 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.054084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575126d1-4ad7-4c21-b3ae-2e1f2f56b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.054352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575126d1-4ad7-4c21-b3ae-2e1f2f56b275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.055001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575126d1-4ad7-4c21-b3ae-2e1f2f56b275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:34.056702 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575126d1-4ad7-4c21-b3ae-2e1f2f56b275 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.070061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1369/2705] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:34.075242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ce24-aab7-492d-9c78-6320b04ff517 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.090320 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ce24-aab7-492d-9c78-6320b04ff517 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:34.097439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670ee93-2489-4275-b841-a99bb65666d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:34.098410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ee93-2489-4275-b841-a99bb65666d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.098701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ee93-2489-4275-b841-a99bb65666d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.099789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ee93-2489-4275-b841-a99bb65666d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.100303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670ee93-2489-4275-b841-a99bb65666d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:34.102097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670ee93-2489-4275-b841-a99bb65666d5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.113900 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1337/2706] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:34.118758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575126d1-4ad7-4c21-b3ae-2e1f2f56b275 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.132116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575126d1-4ad7-4c21-b3ae-2e1f2f56b275 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:34.139903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4304b-1fbe-4473-b889-bcc5fea3456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:34.140733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4304b-1fbe-4473-b889-bcc5fea3456a admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.141155 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4304b-1fbe-4473-b889-bcc5fea3456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.141567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4304b-1fbe-4473-b889-bcc5fea3456a admin admin] PATH_INFO: `/v3/projects/0cac7048982a4316a6318221c7e4f24c/users/c9aa85ecad40422f9d5212b7bd8e7af2/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.162121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4304b-1fbe-4473-b889-bcc5fea3456a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cac7048982a4316a6318221c7e4f24c, user_id=c9aa85ecad40422f9d5212b7bd8e7af2, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:34.165458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4304b-1fbe-4473-b889-bcc5fea3456a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.186989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1370/2707] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:34 2022] PUT /identity/v3/projects/0cac7048982a4316a6318221c7e4f24c/users/c9aa85ecad40422f9d5212b7bd8e7af2/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:34.205396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b726e-c3d3-45fc-af4d-171959b67753 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.205725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b726e-c3d3-45fc-af4d-171959b67753 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.206006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b726e-c3d3-45fc-af4d-171959b67753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.249381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d01b726e-c3d3-45fc-af4d-171959b67753 None None] MFA Rules not processed for user `c9aa85ecad40422f9d5212b7bd8e7af2`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:34.250914 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d01b726e-c3d3-45fc-af4d-171959b67753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:34.340841 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1338/2708] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:34.349894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4304b-1fbe-4473-b889-bcc5fea3456a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.412415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:34.458825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4304b-1fbe-4473-b889-bcc5fea3456a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:34.470122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6ea4a-4970-4d54-bd3f-4bd3b6c04efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:34.470954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ea4a-4970-4d54-bd3f-4bd3b6c04efc admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.471933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ea4a-4970-4d54-bd3f-4bd3b6c04efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.471933 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ea4a-4970-4d54-bd3f-4bd3b6c04efc admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.473286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6ea4a-4970-4d54-bd3f-4bd3b6c04efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:34.479179 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6ea4a-4970-4d54-bd3f-4bd3b6c04efc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.528342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1371/2709] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:34 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:34.533690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b726e-c3d3-45fc-af4d-171959b67753 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.539219 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72352d0-7c69-422e-b7fb-4b2a72971554 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.539511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72352d0-7c69-422e-b7fb-4b2a72971554 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.539996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72352d0-7c69-422e-b7fb-4b2a72971554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.548661 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b726e-c3d3-45fc-af4d-171959b67753 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:34.577712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a72352d0-7c69-422e-b7fb-4b2a72971554 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:34.579277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a72352d0-7c69-422e-b7fb-4b2a72971554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:34.656233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:34.656973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.657319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.657525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.658174 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:34.660139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.669948 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1372/2710] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:34.690361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1339/2711] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:34 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:34.702188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72352d0-7c69-422e-b7fb-4b2a72971554 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.719619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72352d0-7c69-422e-b7fb-4b2a72971554 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:34.729767 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fce72-be9b-4766-8d78-ec5b7ec3c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:34.730497 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fce72-be9b-4766-8d78-ec5b7ec3c0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.731052 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fce72-be9b-4766-8d78-ec5b7ec3c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.731362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fce72-be9b-4766-8d78-ec5b7ec3c0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.732373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fce72-be9b-4766-8d78-ec5b7ec3c0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:34.741150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fce72-be9b-4766-8d78-ec5b7ec3c0a8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.741285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.741285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:34.765925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1373/2712] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:34.767692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fce72-be9b-4766-8d78-ec5b7ec3c0a8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.781820 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fce72-be9b-4766-8d78-ec5b7ec3c0a8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:34.787506 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002653a-cebe-4ace-861f-4141f0c6bc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:34.788189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002653a-cebe-4ace-861f-4141f0c6bc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.788562 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002653a-cebe-4ace-861f-4141f0c6bc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.788896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002653a-cebe-4ace-861f-4141f0c6bc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.789603 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002653a-cebe-4ace-861f-4141f0c6bc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:34.791613 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002653a-cebe-4ace-861f-4141f0c6bc30 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.822512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1374/2713] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:34.825482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002653a-cebe-4ace-861f-4141f0c6bc30 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:34.841206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:34.841662 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002653a-cebe-4ace-861f-4141f0c6bc30 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:34.856875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:34.857818 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:34.858407 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:34.858910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] PATH_INFO: `/v3/projects/4f4fa807de8f4a06b5827eff08e21860/users/c5a615ac0d9a4d25bb0d6729ce5b6a8a/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:34.896673 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4fa807de8f4a06b5827eff08e21860, user_id=c5a615ac0d9a4d25bb0d6729ce5b6a8a, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:34.900572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:34.940625 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1375/2714] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:34 2022] PUT /identity/v3/projects/4f4fa807de8f4a06b5827eff08e21860/users/c5a615ac0d9a4d25bb0d6729ce5b6a8a/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:34.958449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7cd05-4f40-4df2-a1f1-159ebff6e9e2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:35.017295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:35.017295 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:35.083206 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02745465-2e0a-4414-bdaf-b554caee7bba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:35.085033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02745465-2e0a-4414-bdaf-b554caee7bba service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.085324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02745465-2e0a-4414-bdaf-b554caee7bba service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.085603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02745465-2e0a-4414-bdaf-b554caee7bba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.119229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af6e6e-5fd6-469c-a9d3-02009fd14136 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:35.124845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:35.126145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.126145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.126903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] PATH_INFO: `/v3/users/dd4fcbe2bdf14de1a963d0f44d931124` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.128824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4fcbe2bdf14de1a963d0f44d931124)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:35.131251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:35.196744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:35.199376 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02745465-2e0a-4414-bdaf-b554caee7bba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:35.201658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02745465-2e0a-4414-bdaf-b554caee7bba service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:35.213263 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1340/2715] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:39:35.214910 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684669a5-3036-4027-aeee-45cb7cada76a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.215325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684669a5-3036-4027-aeee-45cb7cada76a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.215607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684669a5-3036-4027-aeee-45cb7cada76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.221122 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4fcbe2bdf14de1a963d0f44d931124'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:35.247897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4fcbe2bdf14de1a963d0f44d931124'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:35.256745 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-684669a5-3036-4027-aeee-45cb7cada76a None None] MFA Rules not processed for user `c5a615ac0d9a4d25bb0d6729ce5b6a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:35.258311 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-684669a5-3036-4027-aeee-45cb7cada76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:35.264242 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4fcbe2bdf14de1a963d0f44d931124'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:35.264932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4fcbe2bdf14de1a963d0f44d931124'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:35.265755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-690051b7-40cb-436e-b549-006e56c44587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4fcbe2bdf14de1a963d0f44d931124'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:35.283069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1376/2716] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:35 2022] DELETE /identity/v3/users/dd4fcbe2bdf14de1a963d0f44d931124 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:35.293651 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e78ef-4b83-43c2-9cff-e91e3888affd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.293962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e78ef-4b83-43c2-9cff-e91e3888affd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.295095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e78ef-4b83-43c2-9cff-e91e3888affd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.335869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-957e78ef-4b83-43c2-9cff-e91e3888affd None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:35.337323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-957e78ef-4b83-43c2-9cff-e91e3888affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:35.412014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1341/2717] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:35.425866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684669a5-3036-4027-aeee-45cb7cada76a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:35.428313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-684669a5-3036-4027-aeee-45cb7cada76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:35.466437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684669a5-3036-4027-aeee-45cb7cada76a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:35.471508 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:35.481065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1377/2718] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:35.494210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e78ef-4b83-43c2-9cff-e91e3888affd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:35.496062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-957e78ef-4b83-43c2-9cff-e91e3888affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:35.581169 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a75e2d-aaf6-4139-afbc-ed403ca39dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:35.582155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75e2d-aaf6-4139-afbc-ed403ca39dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.582437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75e2d-aaf6-4139-afbc-ed403ca39dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.582784 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75e2d-aaf6-4139-afbc-ed403ca39dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.583630 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a75e2d-aaf6-4139-afbc-ed403ca39dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:35.585936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a75e2d-aaf6-4139-afbc-ed403ca39dcf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:35.621193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e78ef-4b83-43c2-9cff-e91e3888affd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:35.629548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07c517-49cb-4178-8826-d10461aea5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:35.630681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c517-49cb-4178-8826-d10461aea5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.631186 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c517-49cb-4178-8826-d10461aea5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.632085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c517-49cb-4178-8826-d10461aea5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.642084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1342/2719] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:35 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:35.649848 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a75e2d-aaf6-4139-afbc-ed403ca39dcf admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:35.655789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07c517-49cb-4178-8826-d10461aea5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:35.658016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07c517-49cb-4178-8826-d10461aea5f5 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:35.671542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1378/2720] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:35.768085 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a75e2d-aaf6-4139-afbc-ed403ca39dcf admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:35.775833 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e939-07bb-414b-b2d8-1a96bf5699f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:35.776826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e939-07bb-414b-b2d8-1a96bf5699f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.776826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e939-07bb-414b-b2d8-1a96bf5699f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.777128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e939-07bb-414b-b2d8-1a96bf5699f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.778144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185e939-07bb-414b-b2d8-1a96bf5699f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:35.780905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185e939-07bb-414b-b2d8-1a96bf5699f2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:35.807606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1343/2721] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:35 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:35.813970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07c517-49cb-4178-8826-d10461aea5f5 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:35.830092 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07c517-49cb-4178-8826-d10461aea5f5 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:35.837885 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1213a6-c114-4d4e-838e-eb3afa3c84da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:35.838737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1213a6-c114-4d4e-838e-eb3afa3c84da admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.839330 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1213a6-c114-4d4e-838e-eb3afa3c84da admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.839656 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1213a6-c114-4d4e-838e-eb3afa3c84da admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.840794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1213a6-c114-4d4e-838e-eb3afa3c84da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:35.843053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1213a6-c114-4d4e-838e-eb3afa3c84da admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:35.860338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1379/2722] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:35.865788 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e939-07bb-414b-b2d8-1a96bf5699f2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:35.881092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e939-07bb-414b-b2d8-1a96bf5699f2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:35.887860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183c210-16e8-41aa-abbc-4e9af9b015b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:35.888778 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183c210-16e8-41aa-abbc-4e9af9b015b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:35.889589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183c210-16e8-41aa-abbc-4e9af9b015b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:35.889960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183c210-16e8-41aa-abbc-4e9af9b015b6 admin admin] PATH_INFO: `/v3/projects/b4ceba872c754435882f2664bf237886/users/7f62b23a49724a45a5c350d910a3460c/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:35.918399 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183c210-16e8-41aa-abbc-4e9af9b015b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ceba872c754435882f2664bf237886, user_id=7f62b23a49724a45a5c350d910a3460c, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:35.921276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183c210-16e8-41aa-abbc-4e9af9b015b6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:35.942367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1344/2723] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:35 2022] PUT /identity/v3/projects/b4ceba872c754435882f2664bf237886/users/7f62b23a49724a45a5c350d910a3460c/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:35.943524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1213a6-c114-4d4e-838e-eb3afa3c84da admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:35.955743 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1213a6-c114-4d4e-838e-eb3afa3c84da admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:36.002533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:36.033371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1ce9-8300-442e-b73a-fa4604b067f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:36.034247 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1ce9-8300-442e-b73a-fa4604b067f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.034529 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1ce9-8300-442e-b73a-fa4604b067f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.035855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1ce9-8300-442e-b73a-fa4604b067f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.035855 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1ce9-8300-442e-b73a-fa4604b067f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:36.037143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1ce9-8300-442e-b73a-fa4604b067f4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:36.049089 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1380/2724] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:36.055064 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183c210-16e8-41aa-abbc-4e9af9b015b6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:36.057624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c82c7-661b-4938-a0d6-1b3b2f75b7be None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.058751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c82c7-661b-4938-a0d6-1b3b2f75b7be None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.059050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c82c7-661b-4938-a0d6-1b3b2f75b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.070520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183c210-16e8-41aa-abbc-4e9af9b015b6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:36.083403 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:36.084310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.084724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.085673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] PATH_INFO: `/v3/projects/b4ceba872c754435882f2664bf237886/users/7f62b23a49724a45a5c350d910a3460c/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.087462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ceba872c754435882f2664bf237886, user_id=7f62b23a49724a45a5c350d910a3460c, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:36.089982 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-808c82c7-661b-4938-a0d6-1b3b2f75b7be None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:36.090419 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:36.091320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-808c82c7-661b-4938-a0d6-1b3b2f75b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.104605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1345/2725] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:36 2022] PUT /identity/v3/projects/b4ceba872c754435882f2664bf237886/users/7f62b23a49724a45a5c350d910a3460c/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:36.105602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:36.110185 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.183963 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1381/2726] 10.222.0.55 () {58 vars in 967 bytes} [Tue Sep 13 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:36.186380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683b315-91d7-4225-b9c4-3261f870485f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.186672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683b315-91d7-4225-b9c4-3261f870485f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.186960 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683b315-91d7-4225-b9c4-3261f870485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.198225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:36.229489 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7427c1-b390-4f6b-8b5b-d9e1a0cf8765 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:36.231578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5683b315-91d7-4225-b9c4-3261f870485f None None] MFA Rules not processed for user `7f62b23a49724a45a5c350d910a3460c`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:36.233700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5683b315-91d7-4225-b9c4-3261f870485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.236802 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:36.237627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.238091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.238552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] PATH_INFO: `/v3/projects/c385ffa71fab4718828fff8883d64eed` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.240287 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c385ffa71fab4718828fff8883d64eed)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:36.243568 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:36.320172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c385ffa71fab4718828fff8883d64eed', 'request_id': 'req-d2bc610b-58cb-4009-a2be-4ade8db0a56b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:36.329486 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c385ffa71fab4718828fff8883d64eed', 'request_id': 'req-d2bc610b-58cb-4009-a2be-4ade8db0a56b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:36.340197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c385ffa71fab4718828fff8883d64eed', 'request_id': 'req-d2bc610b-58cb-4009-a2be-4ade8db0a56b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:36.341955 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1382/2727] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:36.346924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683b315-91d7-4225-b9c4-3261f870485f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:36.349479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5683b315-91d7-4225-b9c4-3261f870485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.364434 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] The token cache is being invalidate because project c385ffa71fab4718828fff8883d64eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:36.364929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:36.365941 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:36.367787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1346/2728] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:36 2022] DELETE /identity/v3/projects/c385ffa71fab4718828fff8883d64eed => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:36.373198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:36.373404 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.447527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc610b-58cb-4009-a2be-4ade8db0a56b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:36.447927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683b315-91d7-4225-b9c4-3261f870485f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:36.452438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136e18f-d429-4269-babe-e5983d5cce7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:36.453110 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136e18f-d429-4269-babe-e5983d5cce7a service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.453389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136e18f-d429-4269-babe-e5983d5cce7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.453926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136e18f-d429-4269-babe-e5983d5cce7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.456095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:36.456766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a136e18f-d429-4269-babe-e5983d5cce7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.535181 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e3265-52ee-435b-a3a1-f3da92cdf229 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:36.535825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3265-52ee-435b-a3a1-f3da92cdf229 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.536073 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3265-52ee-435b-a3a1-f3da92cdf229 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.536350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3265-52ee-435b-a3a1-f3da92cdf229 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.540774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d60e3265-52ee-435b-a3a1-f3da92cdf229 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.550570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136e18f-d429-4269-babe-e5983d5cce7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:36.552539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136e18f-d429-4269-babe-e5983d5cce7a service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:36.564758 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1347/2729] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:36.566210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f8cd-1e71-4b64-b44d-d817a104cc2d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.566502 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f8cd-1e71-4b64-b44d-d817a104cc2d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.566782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492f8cd-1e71-4b64-b44d-d817a104cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.609520 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4492f8cd-1e71-4b64-b44d-d817a104cc2d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:36.611426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4492f8cd-1e71-4b64-b44d-d817a104cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.656607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:36.657388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e3265-52ee-435b-a3a1-f3da92cdf229 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:36.659671 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e3265-52ee-435b-a3a1-f3da92cdf229 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:36.673558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1383/2730] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:39:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:39:36.725565 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1348/2731] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:36.734825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44327-7db6-4f00-8056-31bb7504dbf9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.735443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44327-7db6-4f00-8056-31bb7504dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.735897 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44327-7db6-4f00-8056-31bb7504dbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.759915 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a3e44327-7db6-4f00-8056-31bb7504dbf9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:36.761580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a3e44327-7db6-4f00-8056-31bb7504dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:36.776954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1384/2732] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:36.778201 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492f8cd-1e71-4b64-b44d-d817a104cc2d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:36.790412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492f8cd-1e71-4b64-b44d-d817a104cc2d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:36.795892 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:36.796350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.796683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.796958 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.797650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:36.797957 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:36.799894 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:36.819808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1349/2733] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:39:36.829479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e44327-7db6-4f00-8056-31bb7504dbf9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:36.842523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e44327-7db6-4f00-8056-31bb7504dbf9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:36.849190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671e7eb-cee3-4b18-a55d-461585616b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:36.849711 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e7eb-cee3-4b18-a55d-461585616b1b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:36.849995 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e7eb-cee3-4b18-a55d-461585616b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:36.850250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e7eb-cee3-4b18-a55d-461585616b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:36.851125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671e7eb-cee3-4b18-a55d-461585616b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:36.853198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671e7eb-cee3-4b18-a55d-461585616b1b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:36.889670 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1385/2734] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:36 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:36.896768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:36.924004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757223-122c-4bc2-a448-5ffd12e4b516 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:37.008120 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb35d3-e46c-423c-8602-735ccca855ba None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.010036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb35d3-e46c-423c-8602-735ccca855ba None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.010528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb35d3-e46c-423c-8602-735ccca855ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.037343 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b0bb35d3-e46c-423c-8602-735ccca855ba None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:37.038691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b0bb35d3-e46c-423c-8602-735ccca855ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:37.044014 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cc15d-00d0-4edd-82f9-1fd518b007f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:37.045119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc15d-00d0-4edd-82f9-1fd518b007f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.045705 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc15d-00d0-4edd-82f9-1fd518b007f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.046204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cc15d-00d0-4edd-82f9-1fd518b007f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.047289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cc15d-00d0-4edd-82f9-1fd518b007f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:37.050816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cc15d-00d0-4edd-82f9-1fd518b007f8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:37.083029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1350/2735] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:36 2022] POST /identity/v3/users => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:37.087885 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cc15d-00d0-4edd-82f9-1fd518b007f8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:37.102107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1386/2736] 10.222.0.55 () {58 vars in 1009 bytes} [Tue Sep 13 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:37.102481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cc15d-00d0-4edd-82f9-1fd518b007f8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:37.110086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a395e-43cc-4f5f-9670-4552d5e562bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:37.112428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a395e-43cc-4f5f-9670-4552d5e562bb admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.113059 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a395e-43cc-4f5f-9670-4552d5e562bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.113634 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a395e-43cc-4f5f-9670-4552d5e562bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.115094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a395e-43cc-4f5f-9670-4552d5e562bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:37.115216 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb35d3-e46c-423c-8602-735ccca855ba None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:37.117190 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b0bb35d3-e46c-423c-8602-735ccca855ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:37.118690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a395e-43cc-4f5f-9670-4552d5e562bb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:37.137609 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1351/2737] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:37.144177 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a395e-43cc-4f5f-9670-4552d5e562bb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:37.154743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a395e-43cc-4f5f-9670-4552d5e562bb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:37.161266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e6764-38ad-43f7-bfbb-6def518e64e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:37.161673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6764-38ad-43f7-bfbb-6def518e64e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.161949 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6764-38ad-43f7-bfbb-6def518e64e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.162219 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6764-38ad-43f7-bfbb-6def518e64e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.162434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:37.163016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e6764-38ad-43f7-bfbb-6def518e64e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:37.164794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e6764-38ad-43f7-bfbb-6def518e64e4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:37.182132 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1352/2738] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:37.186535 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e6764-38ad-43f7-bfbb-6def518e64e4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:37.200834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e6764-38ad-43f7-bfbb-6def518e64e4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:37.207199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:37.207873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.208142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.208444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] PATH_INFO: `/v3/projects/03c0c5b541524146a0f024ea158f91ed/users/03feaf2c2d4e4160883abdfe19c549a4/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.210124 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb35d3-e46c-423c-8602-735ccca855ba None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:37.215512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9635-3f84-402f-9350-c7e367c48b5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:37.216153 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9635-3f84-402f-9350-c7e367c48b5b service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.216471 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9635-3f84-402f-9350-c7e367c48b5b service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.216749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9635-3f84-402f-9350-c7e367c48b5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.223835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c0c5b541524146a0f024ea158f91ed, user_id=03feaf2c2d4e4160883abdfe19c549a4, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:37.226310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e9635-3f84-402f-9350-c7e367c48b5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:37.226541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:37.228128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e9635-3f84-402f-9350-c7e367c48b5b service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:37.237888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1387/2739] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 12:39:37.248226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1353/2740] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:37 2022] PUT /identity/v3/projects/03c0c5b541524146a0f024ea158f91ed/users/03feaf2c2d4e4160883abdfe19c549a4/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:37.254701 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b98ab-82b1-4a2e-ac97-7914cbd699c6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.254967 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b98ab-82b1-4a2e-ac97-7914cbd699c6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.255316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b98ab-82b1-4a2e-ac97-7914cbd699c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.279411 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6a2b98ab-82b1-4a2e-ac97-7914cbd699c6 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:37.280731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6a2b98ab-82b1-4a2e-ac97-7914cbd699c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:37.367620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1388/2741] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:37.374922 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:37.379530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:37.454484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ea8c0-1e15-409a-a107-39b5219bc585 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:37.461731 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b500d-62a4-41e1-a2ac-b9065d0b08ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:37.462448 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b500d-62a4-41e1-a2ac-b9065d0b08ac service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.462769 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b500d-62a4-41e1-a2ac-b9065d0b08ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.465787 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b500d-62a4-41e1-a2ac-b9065d0b08ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.479969 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b500d-62a4-41e1-a2ac-b9065d0b08ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:37.481786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b500d-62a4-41e1-a2ac-b9065d0b08ac service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:37.493056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1354/2742] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:37.642175 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b98ab-82b1-4a2e-ac97-7914cbd699c6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:37.644283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6a2b98ab-82b1-4a2e-ac97-7914cbd699c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:37.660379 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cc226-e218-4b53-a3f3-569984f83a75 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.662222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cc226-e218-4b53-a3f3-569984f83a75 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.662222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cc226-e218-4b53-a3f3-569984f83a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.666762 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b98ab-82b1-4a2e-ac97-7914cbd699c6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:37.674267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:37.674519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:37.675435 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.676008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.676553 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] PATH_INFO: `/v3/users/ba09f1bf62e540b0906c0060c0547029` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.678588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba09f1bf62e540b0906c0060c0547029)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:37.682323 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:37.698005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8e7cc226-e218-4b53-a3f3-569984f83a75 None None] MFA Rules not processed for user `f0a73e92e13c4e778dcdb2d089c64288`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:37.700796 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8e7cc226-e218-4b53-a3f3-569984f83a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:37.771341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba09f1bf62e540b0906c0060c0547029'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:37.791758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba09f1bf62e540b0906c0060c0547029'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:37.795111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1355/2743] 10.222.0.55 () {58 vars in 967 bytes} [Tue Sep 13 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:37.803383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba09f1bf62e540b0906c0060c0547029'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:37.804036 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba09f1bf62e540b0906c0060c0547029'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:37.805452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b0717f8-57e6-4d83-905e-91ea47afd401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba09f1bf62e540b0906c0060c0547029'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:37.811781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cc226-e218-4b53-a3f3-569984f83a75 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:37.831673 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1389/2744] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:37 2022] DELETE /identity/v3/users/ba09f1bf62e540b0906c0060c0547029 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:37.839180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbefd8-566e-49fd-87f2-10d9ed0cb2b9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:37.840676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbefd8-566e-49fd-87f2-10d9ed0cb2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:37.841251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbefd8-566e-49fd-87f2-10d9ed0cb2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:37.864644 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-45bbefd8-566e-49fd-87f2-10d9ed0cb2b9 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:37.865996 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-45bbefd8-566e-49fd-87f2-10d9ed0cb2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:37.924987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:37.938017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cc226-e218-4b53-a3f3-569984f83a75 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:37.997224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1390/2745] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:38.005550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbefd8-566e-49fd-87f2-10d9ed0cb2b9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:38.007641 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-45bbefd8-566e-49fd-87f2-10d9ed0cb2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:38.053549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246a6a3-f9ec-4c8e-9079-4ace86309fb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149aa4c99a33498282eb285ddebe89d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.057905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246a6a3-f9ec-4c8e-9079-4ace86309fb6 service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.057994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246a6a3-f9ec-4c8e-9079-4ace86309fb6 service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.058407 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246a6a3-f9ec-4c8e-9079-4ace86309fb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.061028 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c246a6a3-f9ec-4c8e-9079-4ace86309fb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:38.145315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbefd8-566e-49fd-87f2-10d9ed0cb2b9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:38.152459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.153253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.153648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.154051 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.158611 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:38.172331 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.174922 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:38.179197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246a6a3-f9ec-4c8e-9079-4ace86309fb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.180978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246a6a3-f9ec-4c8e-9079-4ace86309fb6 service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:38.192428 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1391/2746] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:38.198530 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1356/2747] 10.222.0.55 () {60 vars in 1384 bytes} [Tue Sep 13 12:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:39:38.302653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:38.306543 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:38.322491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779c1c-ffab-4454-8fe0-395866178846 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.322809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779c1c-ffab-4454-8fe0-395866178846 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.323593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779c1c-ffab-4454-8fe0-395866178846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.379126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4d779c1c-ffab-4454-8fe0-395866178846 None None] MFA Rules not processed for user `03feaf2c2d4e4160883abdfe19c549a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:38.382022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4d779c1c-ffab-4454-8fe0-395866178846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:38.467087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0c21e-8b3e-445b-a330-4dd8258c6538 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:38.474775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.476102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.476650 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.477111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.479687 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:38.503410 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1357/2748] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:38.508187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d779c1c-ffab-4454-8fe0-395866178846 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:38.513236 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4d779c1c-ffab-4454-8fe0-395866178846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:38.557755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d779c1c-ffab-4454-8fe0-395866178846 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:38.577915 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.578617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.578912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.579190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.579948 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.581972 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:38.590531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.592011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:38.606932 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1392/2749] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:38.625596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1358/2750] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:38 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:38.626974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:38.642335 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07244824-0978-45f6-a3ad-0115ed261164 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:38.644357 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:38.646699 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:38.680993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:38.742377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88460217-e996-489d-bc2a-9565df53e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.742943 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460217-e996-489d-bc2a-9565df53e3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.743342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460217-e996-489d-bc2a-9565df53e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.743620 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460217-e996-489d-bc2a-9565df53e3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.744263 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88460217-e996-489d-bc2a-9565df53e3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.746311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88460217-e996-489d-bc2a-9565df53e3f0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:38.779355 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1393/2751] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:38 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:38.780321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88460217-e996-489d-bc2a-9565df53e3f0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:38.781155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04272e-9f3a-4b65-89f5-ccc9bfff5aa5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:38.790935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.792104 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.792662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.793047 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88460217-e996-489d-bc2a-9565df53e3f0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:38.793262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] PATH_INFO: `/v3/projects/751d3d49ef5640fab1efd0a213d2713a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.796077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=751d3d49ef5640fab1efd0a213d2713a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.798841 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e488b24-e657-42f8-846a-c586c4f75a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.799491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e488b24-e657-42f8-846a-c586c4f75a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.799825 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e488b24-e657-42f8-846a-c586c4f75a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.800137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e488b24-e657-42f8-846a-c586c4f75a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.800313 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:38.800949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e488b24-e657-42f8-846a-c586c4f75a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.803949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e488b24-e657-42f8-846a-c586c4f75a80 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:38.816890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1394/2752] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:38.821286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e488b24-e657-42f8-846a-c586c4f75a80 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:38.844859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e488b24-e657-42f8-846a-c586c4f75a80 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:38.844859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9d222-730f-4ad0-b90b-3aea4bfdc2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.844859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9d222-730f-4ad0-b90b-3aea4bfdc2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.844859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9d222-730f-4ad0-b90b-3aea4bfdc2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.845218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9d222-730f-4ad0-b90b-3aea4bfdc2eb admin admin] PATH_INFO: `/v3/projects/bb7cfaeefb3e46f88d885b17621ae812/users/ea026adc4e7b4686bbd6d1e37e4b4576/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.869924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9d222-730f-4ad0-b90b-3aea4bfdc2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7cfaeefb3e46f88d885b17621ae812, user_id=ea026adc4e7b4686bbd6d1e37e4b4576, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.873768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9d222-730f-4ad0-b90b-3aea4bfdc2eb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:38.877449 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751d3d49ef5640fab1efd0a213d2713a', 'request_id': 'req-6a41be2b-ad43-4d4b-999a-594d69951f7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:38.886179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751d3d49ef5640fab1efd0a213d2713a', 'request_id': 'req-6a41be2b-ad43-4d4b-999a-594d69951f7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:38.890617 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1395/2753] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:38 2022] PUT /identity/v3/projects/bb7cfaeefb3e46f88d885b17621ae812/users/ea026adc4e7b4686bbd6d1e37e4b4576/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:38.894592 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9d222-730f-4ad0-b90b-3aea4bfdc2eb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:38.901387 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751d3d49ef5640fab1efd0a213d2713a', 'request_id': 'req-6a41be2b-ad43-4d4b-999a-594d69951f7d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:38.903195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:38.921901 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] The token cache is being invalidate because project 751d3d49ef5640fab1efd0a213d2713a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:38.923255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:38.926033 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6a41be2b-ad43-4d4b-999a-594d69951f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:38.930551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1359/2754] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:38 2022] DELETE /identity/v3/projects/751d3d49ef5640fab1efd0a213d2713a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:38.937834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca589-439b-4a05-ab56-f2362f110541 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.937834 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca589-439b-4a05-ab56-f2362f110541 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.938682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca589-439b-4a05-ab56-f2362f110541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.978909 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-eedca589-439b-4a05-ab56-f2362f110541 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:38.982030 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-eedca589-439b-4a05-ab56-f2362f110541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:38.985417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9d222-730f-4ad0-b90b-3aea4bfdc2eb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:38.992307 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:38.993459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:38.993775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:38.994115 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:38.995129 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:38.996775 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.004612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1360/2755] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:39.013756 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30811c4c-3a84-46b9-a11f-0350f05e1adc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.014225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30811c4c-3a84-46b9-a11f-0350f05e1adc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.014651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30811c4c-3a84-46b9-a11f-0350f05e1adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.023811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1396/2756] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:39.028283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.030294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:39.042808 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-30811c4c-3a84-46b9-a11f-0350f05e1adc None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:39.044417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-30811c4c-3a84-46b9-a11f-0350f05e1adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:39.049839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea62e4-9bb6-40b5-bc58-7423fc4abf33 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:39.057542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ad7ad-0c35-44c2-9bb9-37f5abe167ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:39.058362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad7ad-0c35-44c2-9bb9-37f5abe167ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.058800 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad7ad-0c35-44c2-9bb9-37f5abe167ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.059143 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad7ad-0c35-44c2-9bb9-37f5abe167ea admin admin] PATH_INFO: `/v3/projects/bb7cfaeefb3e46f88d885b17621ae812/users/ea026adc4e7b4686bbd6d1e37e4b4576/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.060080 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1361/2757] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:39.061452 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ad7ad-0c35-44c2-9bb9-37f5abe167ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7cfaeefb3e46f88d885b17621ae812, user_id=ea026adc4e7b4686bbd6d1e37e4b4576, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:39.064338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30811c4c-3a84-46b9-a11f-0350f05e1adc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.064704 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ad7ad-0c35-44c2-9bb9-37f5abe167ea admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.077037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1397/2758] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:39 2022] PUT /identity/v3/projects/bb7cfaeefb3e46f88d885b17621ae812/users/ea026adc4e7b4686bbd6d1e37e4b4576/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:39.082442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30811c4c-3a84-46b9-a11f-0350f05e1adc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:39.180690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:39.180690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.180690 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.180986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.181544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:39.181860 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:39.183627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.197182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1362/2759] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:39.202103 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ad7ad-0c35-44c2-9bb9-37f5abe167ea admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.218345 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ad7ad-0c35-44c2-9bb9-37f5abe167ea admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:39.225351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018021fe-5778-4a61-bd24-ae93e9a3a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:39.226695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018021fe-5778-4a61-bd24-ae93e9a3a418 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.226985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018021fe-5778-4a61-bd24-ae93e9a3a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.227262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018021fe-5778-4a61-bd24-ae93e9a3a418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.227930 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018021fe-5778-4a61-bd24-ae93e9a3a418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:39.230107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018021fe-5778-4a61-bd24-ae93e9a3a418 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.332728 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1398/2760] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:39 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:39.333862 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.348103 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d0348-364e-4862-b58b-70ae21a8b001 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:39.424589 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:39.428697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.429632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.430155 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.431119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:39.434161 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.491971 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1363/2761] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:39 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:39.506438 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018021fe-5778-4a61-bd24-ae93e9a3a418 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.534983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018021fe-5778-4a61-bd24-ae93e9a3a418 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:39.547121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73214d4a-b7f5-4de9-9128-6d124cc2e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:39.548189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214d4a-b7f5-4de9-9128-6d124cc2e908 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.548698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214d4a-b7f5-4de9-9128-6d124cc2e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.549169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214d4a-b7f5-4de9-9128-6d124cc2e908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.550262 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73214d4a-b7f5-4de9-9128-6d124cc2e908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:39.553319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73214d4a-b7f5-4de9-9128-6d124cc2e908 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.556662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.558951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:39.577401 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1399/2762] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:39.583639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73214d4a-b7f5-4de9-9128-6d124cc2e908 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.608794 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73214d4a-b7f5-4de9-9128-6d124cc2e908 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:39.615178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72957d74-8d40-4349-a040-f533dfe8f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:39.615814 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957d74-8d40-4349-a040-f533dfe8f7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.616074 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957d74-8d40-4349-a040-f533dfe8f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.617377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957d74-8d40-4349-a040-f533dfe8f7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.617377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72957d74-8d40-4349-a040-f533dfe8f7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:39.619626 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72957d74-8d40-4349-a040-f533dfe8f7ac admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.633577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1400/2763] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:39.638365 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72957d74-8d40-4349-a040-f533dfe8f7ac admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.650270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72957d74-8d40-4349-a040-f533dfe8f7ac admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:39.665570 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7798a-1ef0-40fa-bec8-973e8590fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:39.666397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7798a-1ef0-40fa-bec8-973e8590fb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.669905 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7798a-1ef0-40fa-bec8-973e8590fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.670431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7798a-1ef0-40fa-bec8-973e8590fb2c admin admin] PATH_INFO: `/v3/projects/5cf9630b32dd4322bcc4e0d540e4b81e/users/d126f9f06e5a480498987e553db5888e/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.689577 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc102078-c19f-4281-80e2-f79dae81a694 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:39.704102 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7798a-1ef0-40fa-bec8-973e8590fb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf9630b32dd4322bcc4e0d540e4b81e, user_id=d126f9f06e5a480498987e553db5888e, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:39.707057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7798a-1ef0-40fa-bec8-973e8590fb2c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.708038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:39.712614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:39.713753 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.714216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.714945 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.721857 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:39.741141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1401/2764] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:39 2022] PUT /identity/v3/projects/5cf9630b32dd4322bcc4e0d540e4b81e/users/d126f9f06e5a480498987e553db5888e/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:39.743724 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:39.758647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189807f6-4adf-4b77-a340-639f758aeff0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:39.759654 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189807f6-4adf-4b77-a340-639f758aeff0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:39.760117 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189807f6-4adf-4b77-a340-639f758aeff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:39.798338 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-189807f6-4adf-4b77-a340-639f758aeff0 None None] MFA Rules not processed for user `d126f9f06e5a480498987e553db5888e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:39.799590 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-189807f6-4adf-4b77-a340-639f758aeff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:39.842255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:39.845515 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:39.857853 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1364/2765] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:39.917161 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1402/2766] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:39.932032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:39.937525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:39.963151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b696e-55e4-4e22-b698-73508a8bb4af service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:40.037810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:40.038441 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:40.038717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:40.038985 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:40.050622 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:40.052852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:40.063101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1365/2767] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:40.391552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f475-7050-417c-b4fd-638279cfe295 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:40.391853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f475-7050-417c-b4fd-638279cfe295 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:40.392408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f475-7050-417c-b4fd-638279cfe295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:40.430747 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2e82f475-7050-417c-b4fd-638279cfe295 None None] MFA Rules not processed for user `ea026adc4e7b4686bbd6d1e37e4b4576`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:40.432283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2e82f475-7050-417c-b4fd-638279cfe295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:40.519462 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1403/2768] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:40.842722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:40.844245 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:40.935275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82758-e96a-4e72-9c6f-66b1371eb59e service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:40.943108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:40.944180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:40.944685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:40.945172 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] PATH_INFO: `/v3/users/ad51b0f1c6e74d4e8dcebeb080b98451` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:40.947304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad51b0f1c6e74d4e8dcebeb080b98451)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:40.950401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:41.019432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad51b0f1c6e74d4e8dcebeb080b98451'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.031036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad51b0f1c6e74d4e8dcebeb080b98451'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.033045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad51b0f1c6e74d4e8dcebeb080b98451'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.033880 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad51b0f1c6e74d4e8dcebeb080b98451'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.036936 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:41.053728 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad51b0f1c6e74d4e8dcebeb080b98451'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.084003 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1366/2769] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:40 2022] DELETE /identity/v3/users/ad51b0f1c6e74d4e8dcebeb080b98451 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:41.090041 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72058e7-509e-4153-a100-c9cf2bf22d88 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:41.090607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72058e7-509e-4153-a100-c9cf2bf22d88 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:41.090607 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72058e7-509e-4153-a100-c9cf2bf22d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:41.115968 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b72058e7-509e-4153-a100-c9cf2bf22d88 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:41.117301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b72058e7-509e-4153-a100-c9cf2bf22d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:41.202665 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1404/2770] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:41.213869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:41.215471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:41.298476 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779eaa-6e90-424b-a70a-efd758aa78c8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:41.302823 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:41.303883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:41.304362 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:41.304874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:41.319372 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:41.320929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:41.333044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1367/2771] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:41.736129 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72058e7-509e-4153-a100-c9cf2bf22d88 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:41.737795 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b72058e7-509e-4153-a100-c9cf2bf22d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:41.774243 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72058e7-509e-4153-a100-c9cf2bf22d88 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:41.795858 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:41.800719 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:41.802619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:41.804241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] PATH_INFO: `/v3/projects/08ed8ebfe79141cdaa9b3444fc204d86` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:41.816481 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ed8ebfe79141cdaa9b3444fc204d86)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:41.820541 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:41.833653 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:41.907760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ed8ebfe79141cdaa9b3444fc204d86', 'request_id': 'req-2b9306e5-826b-4f6f-9298-261a4afc7000'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.919522 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ed8ebfe79141cdaa9b3444fc204d86', 'request_id': 'req-2b9306e5-826b-4f6f-9298-261a4afc7000'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.931011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ed8ebfe79141cdaa9b3444fc204d86', 'request_id': 'req-2b9306e5-826b-4f6f-9298-261a4afc7000'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.956712 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] The token cache is being invalidate because project 08ed8ebfe79141cdaa9b3444fc204d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:41.957012 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.958145 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:41.961127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1405/2772] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:41 2022] DELETE /identity/v3/projects/08ed8ebfe79141cdaa9b3444fc204d86 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:42.049699 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:42.053584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:42.081208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d5269-ec3a-47da-be21-70655733bab9 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:42.175117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:42.175786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:42.176067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:42.176337 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] PATH_INFO: `/v3/users/03feaf2c2d4e4160883abdfe19c549a4` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:42.177851 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] RBAC: Authorizing `identity:delete_user(user_id=03feaf2c2d4e4160883abdfe19c549a4)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:42.179811 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:42.256126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03feaf2c2d4e4160883abdfe19c549a4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.267961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03feaf2c2d4e4160883abdfe19c549a4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.268801 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03feaf2c2d4e4160883abdfe19c549a4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.269446 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03feaf2c2d4e4160883abdfe19c549a4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.279153 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03feaf2c2d4e4160883abdfe19c549a4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.294382 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:42.309946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1368/2773] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:42 2022] DELETE /identity/v3/users/03feaf2c2d4e4160883abdfe19c549a4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:42.527941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:42.530341 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:42.572950 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9306e5-826b-4f6f-9298-261a4afc7000 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:42.669037 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:42.669721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:42.670079 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:42.670283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] PATH_INFO: `/v3/projects/03c0c5b541524146a0f024ea158f91ed` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:42.671618 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c0c5b541524146a0f024ea158f91ed)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:42.674310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:42.747469 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c0c5b541524146a0f024ea158f91ed', 'request_id': 'req-f4930146-287d-45cd-a4a7-aa6093d39de0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.759406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c0c5b541524146a0f024ea158f91ed', 'request_id': 'req-f4930146-287d-45cd-a4a7-aa6093d39de0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.769101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c0c5b541524146a0f024ea158f91ed', 'request_id': 'req-f4930146-287d-45cd-a4a7-aa6093d39de0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.789878 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] The token cache is being invalidate because project 03c0c5b541524146a0f024ea158f91ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:42.790231 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.791180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:42.793503 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1406/2774] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:42 2022] DELETE /identity/v3/projects/03c0c5b541524146a0f024ea158f91ed => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:42.799683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:42.801539 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:42.822478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df761696-fad3-4d73-8ef3-228ba634b07b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:42.853495 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:42.855337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:42.898026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:42.926191 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:42.927300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:42.927786 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:42.928281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] PATH_INFO: `/v3/users/ea026adc4e7b4686bbd6d1e37e4b4576` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:42.930466 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea026adc4e7b4686bbd6d1e37e4b4576)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:42.934437 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:42.951969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930146-287d-45cd-a4a7-aa6093d39de0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:42.959237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:42.960297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:42.960760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:42.961188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] PATH_INFO: `/v3/users/d126f9f06e5a480498987e553db5888e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:42.962740 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d126f9f06e5a480498987e553db5888e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:42.965204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:43.031503 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea026adc4e7b4686bbd6d1e37e4b4576'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.043507 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea026adc4e7b4686bbd6d1e37e4b4576'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.044304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea026adc4e7b4686bbd6d1e37e4b4576'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.045023 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea026adc4e7b4686bbd6d1e37e4b4576'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.055721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-31e1e794-4851-440f-915d-90c2dbb88e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea026adc4e7b4686bbd6d1e37e4b4576'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.060252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd126f9f06e5a480498987e553db5888e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.085986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1369/2775] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:42 2022] DELETE /identity/v3/users/ea026adc4e7b4686bbd6d1e37e4b4576 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:43.089917 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd126f9f06e5a480498987e553db5888e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.105324 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd126f9f06e5a480498987e553db5888e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.106142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd126f9f06e5a480498987e553db5888e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.106976 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd126f9f06e5a480498987e553db5888e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.121462 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1407/2776] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:42 2022] DELETE /identity/v3/users/d126f9f06e5a480498987e553db5888e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:43.126338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d682727-780e-409e-a0c6-e5d349b3f98e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.126667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d682727-780e-409e-a0c6-e5d349b3f98e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.126924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d682727-780e-409e-a0c6-e5d349b3f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.148699 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3d682727-780e-409e-a0c6-e5d349b3f98e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:43.150211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3d682727-780e-409e-a0c6-e5d349b3f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:43.227757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1370/2777] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:43.238565 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:43.240566 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:43.306646 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d682727-780e-409e-a0c6-e5d349b3f98e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:43.309228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3d682727-780e-409e-a0c6-e5d349b3f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:43.319397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3b75b-0e8e-43a1-9f27-69b060e0baba admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:43.323476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df848fa-f39e-4360-9246-8adbe9723d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:43.324113 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df848fa-f39e-4360-9246-8adbe9723d12 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.324555 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df848fa-f39e-4360-9246-8adbe9723d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.324890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df848fa-f39e-4360-9246-8adbe9723d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.328943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d682727-780e-409e-a0c6-e5d349b3f98e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:43.336272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df848fa-f39e-4360-9246-8adbe9723d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:43.337700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:43.337864 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df848fa-f39e-4360-9246-8adbe9723d12 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:43.338537 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.338872 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.339149 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] PATH_INFO: `/v3/projects/bb7cfaeefb3e46f88d885b17621ae812` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.340641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7cfaeefb3e46f88d885b17621ae812)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:43.342659 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:43.349395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1408/2778] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:43.357002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:43.418293 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7cfaeefb3e46f88d885b17621ae812', 'request_id': 'req-04f5a182-25fa-4fe6-aad1-0396c5433e28'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.425198 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7cfaeefb3e46f88d885b17621ae812', 'request_id': 'req-04f5a182-25fa-4fe6-aad1-0396c5433e28'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.434274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7cfaeefb3e46f88d885b17621ae812', 'request_id': 'req-04f5a182-25fa-4fe6-aad1-0396c5433e28'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.452682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] The token cache is being invalidate because project bb7cfaeefb3e46f88d885b17621ae812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:43.453190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.454353 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-04f5a182-25fa-4fe6-aad1-0396c5433e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.457072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1371/2779] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:43 2022] DELETE /identity/v3/projects/bb7cfaeefb3e46f88d885b17621ae812 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:43.466083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1419-f789-4334-a485-f4aa5e6b8d1b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.466083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1419-f789-4334-a485-f4aa5e6b8d1b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.466083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1419-f789-4334-a485-f4aa5e6b8d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.486423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5e7e1419-f789-4334-a485-f4aa5e6b8d1b None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:43.487690 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5e7e1419-f789-4334-a485-f4aa5e6b8d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:43.543845 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:43.577133 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1409/2780] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:43.586791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d774-0506-4202-be2f-8c90279e6274 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.587114 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d774-0506-4202-be2f-8c90279e6274 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.587393 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d774-0506-4202-be2f-8c90279e6274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.610257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e214d774-0506-4202-be2f-8c90279e6274 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:43.611645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e214d774-0506-4202-be2f-8c90279e6274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:43.628832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1372/2781] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:43.633083 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e1419-f789-4334-a485-f4aa5e6b8d1b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:43.647482 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e1419-f789-4334-a485-f4aa5e6b8d1b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:43.652971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:43.653729 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.654005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.654447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.655130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:43.655434 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:43.657526 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:43.672026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1410/2782] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:43.676510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214d774-0506-4202-be2f-8c90279e6274 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:43.689850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214d774-0506-4202-be2f-8c90279e6274 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:43.698195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aa6c-19d2-44d5-80ba-946c33dd57c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:43.699251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aa6c-19d2-44d5-80ba-946c33dd57c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.699743 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aa6c-19d2-44d5-80ba-946c33dd57c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.700222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aa6c-19d2-44d5-80ba-946c33dd57c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.701444 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406aa6c-19d2-44d5-80ba-946c33dd57c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:43.705338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406aa6c-19d2-44d5-80ba-946c33dd57c0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:43.736904 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:43.739062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:43.744617 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1373/2783] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:43 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:43.746089 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aa6c-19d2-44d5-80ba-946c33dd57c0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:43.753727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08ee65-feb6-4e4f-974c-4b5e84a2e47a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:43.852468 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aa6c-19d2-44d5-80ba-946c33dd57c0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:43.858942 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1dae-baa0-488b-b3e2-7947a9bc3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:43.859685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1dae-baa0-488b-b3e2-7947a9bc3305 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.860045 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1dae-baa0-488b-b3e2-7947a9bc3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.860423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1dae-baa0-488b-b3e2-7947a9bc3305 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.861131 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:43.861500 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de1dae-baa0-488b-b3e2-7947a9bc3305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:43.862196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.862696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.863197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] PATH_INFO: `/v3/projects/5cf9630b32dd4322bcc4e0d540e4b81e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.863836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de1dae-baa0-488b-b3e2-7947a9bc3305 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:43.865269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf9630b32dd4322bcc4e0d540e4b81e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:43.868949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:43.890101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1374/2784] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:43 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:43.895292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1dae-baa0-488b-b3e2-7947a9bc3305 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:43.906895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1dae-baa0-488b-b3e2-7947a9bc3305 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:43.912748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabdcfb-c642-4a97-b385-da88cf2a3177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:43.913383 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabdcfb-c642-4a97-b385-da88cf2a3177 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:43.913666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabdcfb-c642-4a97-b385-da88cf2a3177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:43.913943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabdcfb-c642-4a97-b385-da88cf2a3177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:43.914601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabdcfb-c642-4a97-b385-da88cf2a3177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:43.916251 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabdcfb-c642-4a97-b385-da88cf2a3177 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:43.928061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1375/2785] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:43.932605 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabdcfb-c642-4a97-b385-da88cf2a3177 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:43.943700 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabdcfb-c642-4a97-b385-da88cf2a3177 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:43.945970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf9630b32dd4322bcc4e0d540e4b81e', 'request_id': 'req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.958045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf9630b32dd4322bcc4e0d540e4b81e', 'request_id': 'req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.966203 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf9630b32dd4322bcc4e0d540e4b81e', 'request_id': 'req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.985487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] The token cache is being invalidate because project 5cf9630b32dd4322bcc4e0d540e4b81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:43.985822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.986894 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:43.988939 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1411/2786] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:43 2022] DELETE /identity/v3/projects/5cf9630b32dd4322bcc4e0d540e4b81e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:43.996645 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:44.016616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55215b-2b6e-4df1-b832-a63dab5e9fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.017068 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55215b-2b6e-4df1-b832-a63dab5e9fab admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.017389 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55215b-2b6e-4df1-b832-a63dab5e9fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.017632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55215b-2b6e-4df1-b832-a63dab5e9fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.018325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55215b-2b6e-4df1-b832-a63dab5e9fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.020026 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55215b-2b6e-4df1-b832-a63dab5e9fab admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.036084 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1376/2787] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:44.041479 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.044003 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:44.059287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c56a9-ba1f-4d8c-88fb-315f8e1e329f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.065542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.066299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.066574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.066847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] PATH_INFO: `/v3/projects/88eb629e10d54af099da1b36fc5a44b8/users/9896da2adb8f43f39382a53a23a263d6/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.090087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=88eb629e10d54af099da1b36fc5a44b8, user_id=9896da2adb8f43f39382a53a23a263d6, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.094965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.115158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1412/2788] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:44 2022] PUT /identity/v3/projects/88eb629e10d54af099da1b36fc5a44b8/users/9896da2adb8f43f39382a53a23a263d6/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:44.126864 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbdba1-966a-4e66-9d05-1f3f0da0c674 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.127442 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbdba1-966a-4e66-9d05-1f3f0da0c674 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.127529 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbdba1-966a-4e66-9d05-1f3f0da0c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.162485 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-92dbdba1-966a-4e66-9d05-1f3f0da0c674 None None] MFA Rules not processed for user `9896da2adb8f43f39382a53a23a263d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:44.163966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-92dbdba1-966a-4e66-9d05-1f3f0da0c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:44.225059 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.227121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:44.292552 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1377/2789] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:44.293867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbdba1-966a-4e66-9d05-1f3f0da0c674 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.299748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:44.325578 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da630cda-c90a-4a32-8b80-83c532786daa admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.331524 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.332128 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.332505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.332686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] PATH_INFO: `/v3/users/c9aa85ecad40422f9d5212b7bd8e7af2` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.333962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9aa85ecad40422f9d5212b7bd8e7af2)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.335983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.371092 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbdba1-966a-4e66-9d05-1f3f0da0c674 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.376973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.377606 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.377891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.378171 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.378818 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.380817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.392371 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9aa85ecad40422f9d5212b7bd8e7af2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:44.405560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9aa85ecad40422f9d5212b7bd8e7af2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:44.414709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9aa85ecad40422f9d5212b7bd8e7af2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:44.415395 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9aa85ecad40422f9d5212b7bd8e7af2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:44.415521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1378/2790] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:44 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:44.419511 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-24fb2723-e17b-4962-952e-a21296605def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9aa85ecad40422f9d5212b7bd8e7af2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:44.419960 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.422303 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:44.435173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1413/2791] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:44 2022] DELETE /identity/v3/users/c9aa85ecad40422f9d5212b7bd8e7af2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:44.441372 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273ff8-7d1c-4c20-bed6-bcbe10c6cdc5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.441606 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273ff8-7d1c-4c20-bed6-bcbe10c6cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.441912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273ff8-7d1c-4c20-bed6-bcbe10c6cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.464448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1c273ff8-7d1c-4c20-bed6-bcbe10c6cdc5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:44.464669 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1c273ff8-7d1c-4c20-bed6-bcbe10c6cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:44.503369 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:44.510570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5c56-36af-4eba-84c0-5326cda770d6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.533405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1414/2792] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:39:44.545768 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273ff8-7d1c-4c20-bed6-bcbe10c6cdc5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.548055 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1c273ff8-7d1c-4c20-bed6-bcbe10c6cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:44.590620 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492c22-4a93-4885-8616-20475d872f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.591277 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492c22-4a93-4885-8616-20475d872f36 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.591557 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492c22-4a93-4885-8616-20475d872f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.591827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492c22-4a93-4885-8616-20475d872f36 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.593305 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492c22-4a93-4885-8616-20475d872f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.595670 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492c22-4a93-4885-8616-20475d872f36 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.621931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c273ff8-7d1c-4c20-bed6-bcbe10c6cdc5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.626258 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ac7f-a35a-4965-b3c3-0a2caf2c2273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.626949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ac7f-a35a-4965-b3c3-0a2caf2c2273 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.627531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1379/2793] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:44 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:44.627736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ac7f-a35a-4965-b3c3-0a2caf2c2273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.627736 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ac7f-a35a-4965-b3c3-0a2caf2c2273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.631547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492c22-4a93-4885-8616-20475d872f36 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.639226 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ac7f-a35a-4965-b3c3-0a2caf2c2273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.640940 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ac7f-a35a-4965-b3c3-0a2caf2c2273 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.643021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492c22-4a93-4885-8616-20475d872f36 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.648270 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8e2f-48ce-46a0-a8a3-8660cbc444e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.648974 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8e2f-48ce-46a0-a8a3-8660cbc444e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.649241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8e2f-48ce-46a0-a8a3-8660cbc444e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.649510 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8e2f-48ce-46a0-a8a3-8660cbc444e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.650190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd8e2f-48ce-46a0-a8a3-8660cbc444e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.651800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd8e2f-48ce-46a0-a8a3-8660cbc444e4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.653537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1415/2794] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:44.664351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1380/2795] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:39:44.669733 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ac7f-a35a-4965-b3c3-0a2caf2c2273 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.675819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:44.683188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ac7f-a35a-4965-b3c3-0a2caf2c2273 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.690952 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a837-ba2d-4ef3-8f87-e8b873ecc7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.691715 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a837-ba2d-4ef3-8f87-e8b873ecc7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.691884 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a837-ba2d-4ef3-8f87-e8b873ecc7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.692369 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a837-ba2d-4ef3-8f87-e8b873ecc7e6 admin admin] PATH_INFO: `/v3/projects/0f07891b5a54449bb7912e6005daf10a/users/84106ed41246423d971e30c75229f793/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.717701 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a837-ba2d-4ef3-8f87-e8b873ecc7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f07891b5a54449bb7912e6005daf10a, user_id=84106ed41246423d971e30c75229f793, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.721174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a837-ba2d-4ef3-8f87-e8b873ecc7e6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.738824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1416/2796] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:44 2022] PUT /identity/v3/projects/0f07891b5a54449bb7912e6005daf10a/users/84106ed41246423d971e30c75229f793/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:44.744058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8e2f-48ce-46a0-a8a3-8660cbc444e4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.756240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8e2f-48ce-46a0-a8a3-8660cbc444e4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.836058 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d95d8d-1916-46eb-b5b5-1a88df8d6723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.837495 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95d8d-1916-46eb-b5b5-1a88df8d6723 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.837844 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95d8d-1916-46eb-b5b5-1a88df8d6723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.838152 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95d8d-1916-46eb-b5b5-1a88df8d6723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.839223 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d95d8d-1916-46eb-b5b5-1a88df8d6723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.842827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d95d8d-1916-46eb-b5b5-1a88df8d6723 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.858674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1381/2797] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:44.863547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a837-ba2d-4ef3-8f87-e8b873ecc7e6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:44.878072 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a837-ba2d-4ef3-8f87-e8b873ecc7e6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:44.884520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:44.885321 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.886234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.886234 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] PATH_INFO: `/v3/projects/0f07891b5a54449bb7912e6005daf10a/users/84106ed41246423d971e30c75229f793/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.888515 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f07891b5a54449bb7912e6005daf10a, user_id=84106ed41246423d971e30c75229f793, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:44.891509 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:44.903357 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1417/2798] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:44 2022] PUT /identity/v3/projects/0f07891b5a54449bb7912e6005daf10a/users/84106ed41246423d971e30c75229f793/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:44.915398 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4e3ea-9ded-4d48-a0f1-7bdbb6fde17e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:44.915789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4e3ea-9ded-4d48-a0f1-7bdbb6fde17e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:44.916115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4e3ea-9ded-4d48-a0f1-7bdbb6fde17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:44.948561 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-72e4e3ea-9ded-4d48-a0f1-7bdbb6fde17e None None] MFA Rules not processed for user `84106ed41246423d971e30c75229f793`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:44.949816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-72e4e3ea-9ded-4d48-a0f1-7bdbb6fde17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:45.011059 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:45.013609 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:45.037976 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1382/2799] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:45.053701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4e3ea-9ded-4d48-a0f1-7bdbb6fde17e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:45.055912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-72e4e3ea-9ded-4d48-a0f1-7bdbb6fde17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:45.064073 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:45.103291 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e4fde-c5e0-40a0-8f4d-8b6798f6e0b9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:45.109194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:45.109907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:45.110265 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:45.110605 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] PATH_INFO: `/v3/projects/0cac7048982a4316a6318221c7e4f24c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:45.111949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cac7048982a4316a6318221c7e4f24c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:45.114044 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:45.127610 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4e3ea-9ded-4d48-a0f1-7bdbb6fde17e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:45.131859 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e7ef-b97e-4fb4-973d-2bc56e179dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:45.132534 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e7ef-b97e-4fb4-973d-2bc56e179dba service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:45.132816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e7ef-b97e-4fb4-973d-2bc56e179dba service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:45.133091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e7ef-b97e-4fb4-973d-2bc56e179dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:45.145078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969e7ef-b97e-4fb4-973d-2bc56e179dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:45.146733 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969e7ef-b97e-4fb4-973d-2bc56e179dba service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:45.159144 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1383/2800] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:45.173681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cac7048982a4316a6318221c7e4f24c', 'request_id': 'req-88a113be-55c3-4ee6-b646-0793190ed58b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.181737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cac7048982a4316a6318221c7e4f24c', 'request_id': 'req-88a113be-55c3-4ee6-b646-0793190ed58b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.189494 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cac7048982a4316a6318221c7e4f24c', 'request_id': 'req-88a113be-55c3-4ee6-b646-0793190ed58b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.203455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] The token cache is being invalidate because project 0cac7048982a4316a6318221c7e4f24c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:45.203455 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.204289 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.206054 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1418/2801] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:45 2022] DELETE /identity/v3/projects/0cac7048982a4316a6318221c7e4f24c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:45.211176 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e7ef-b97e-4fb4-973d-2bc56e179dba service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:45.222926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e7ef-b97e-4fb4-973d-2bc56e179dba service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:45.250730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:45.252280 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:45.294271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:45.294954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:45.295229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:45.295527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] PATH_INFO: `/v3/users/c5a615ac0d9a4d25bb0d6729ce5b6a8a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:45.296871 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a615ac0d9a4d25bb0d6729ce5b6a8a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:45.299381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:45.318973 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a113be-55c3-4ee6-b646-0793190ed58b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:45.323571 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:45.324682 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:45.325630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:45.325840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:45.327774 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:45.340002 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:45.353693 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a615ac0d9a4d25bb0d6729ce5b6a8a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.364049 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a615ac0d9a4d25bb0d6729ce5b6a8a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.364797 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a615ac0d9a4d25bb0d6729ce5b6a8a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.365451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a615ac0d9a4d25bb0d6729ce5b6a8a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.375551 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a615ac0d9a4d25bb0d6729ce5b6a8a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.400644 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1384/2802] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:45 2022] DELETE /identity/v3/users/c5a615ac0d9a4d25bb0d6729ce5b6a8a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:39:45.411792 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:45.413389 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:45.424548 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1419/2803] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:39:45.725695 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:45.727220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:45.761688 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:45.799262 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9cb39-f99b-49d7-b14b-60ca1e37f3de admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:45.804082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:45.804764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:45.805046 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:45.805367 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] PATH_INFO: `/v3/projects/4f4fa807de8f4a06b5827eff08e21860` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:45.806484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4fa807de8f4a06b5827eff08e21860)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:45.808432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:45.861785 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4fa807de8f4a06b5827eff08e21860', 'request_id': 'req-b0a1d19f-9340-47de-ab03-f618a0abbded'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.868541 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4fa807de8f4a06b5827eff08e21860', 'request_id': 'req-b0a1d19f-9340-47de-ab03-f618a0abbded'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.877351 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4fa807de8f4a06b5827eff08e21860', 'request_id': 'req-b0a1d19f-9340-47de-ab03-f618a0abbded'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.889927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] The token cache is being invalidate because project 4f4fa807de8f4a06b5827eff08e21860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:45.890242 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.891133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:45.892803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1385/2804] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:45 2022] DELETE /identity/v3/projects/4f4fa807de8f4a06b5827eff08e21860 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:45.897311 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:45.899161 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:45.914272 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce72d7-7c32-499e-bb4a-b9d3bcfcea71 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:45.979114 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e288239-c797-4977-8958-50a695750425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:45.979850 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e288239-c797-4977-8958-50a695750425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:45.980200 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e288239-c797-4977-8958-50a695750425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:45.980554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e288239-c797-4977-8958-50a695750425 admin admin] PATH_INFO: `/v3/users/7f62b23a49724a45a5c350d910a3460c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:45.981853 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e288239-c797-4977-8958-50a695750425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f62b23a49724a45a5c350d910a3460c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:45.983986 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e288239-c797-4977-8958-50a695750425 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:46.043287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7e288239-c797-4977-8958-50a695750425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f62b23a49724a45a5c350d910a3460c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.057691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7e288239-c797-4977-8958-50a695750425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f62b23a49724a45a5c350d910a3460c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.067874 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7e288239-c797-4977-8958-50a695750425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f62b23a49724a45a5c350d910a3460c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.068629 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7e288239-c797-4977-8958-50a695750425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f62b23a49724a45a5c350d910a3460c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.069319 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7e288239-c797-4977-8958-50a695750425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f62b23a49724a45a5c350d910a3460c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.084430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1420/2805] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:39:45 2022] DELETE /identity/v3/users/7f62b23a49724a45a5c350d910a3460c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:46.387197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:46.389192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:46.418979 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1d19f-9340-47de-ab03-f618a0abbded admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:46.484722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:46.485641 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:46.485847 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:46.486157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] PATH_INFO: `/v3/projects/b4ceba872c754435882f2664bf237886` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:46.487566 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ceba872c754435882f2664bf237886)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:46.489601 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:46.543538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ceba872c754435882f2664bf237886', 'request_id': 'req-e02036c3-7be2-4fb7-89a5-d70a484503ba'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.550558 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ceba872c754435882f2664bf237886', 'request_id': 'req-e02036c3-7be2-4fb7-89a5-d70a484503ba'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.554450 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:46.561338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ceba872c754435882f2664bf237886', 'request_id': 'req-e02036c3-7be2-4fb7-89a5-d70a484503ba'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.574766 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] The token cache is being invalidate because project b4ceba872c754435882f2664bf237886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:39:46.575040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.575748 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e02036c3-7be2-4fb7-89a5-d70a484503ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:39:46.577336 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1386/2806] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:39:46 2022] DELETE /identity/v3/projects/b4ceba872c754435882f2664bf237886 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:46.586596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f452c9-5225-4b88-b7a0-b88639bcd416 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:46.586900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f452c9-5225-4b88-b7a0-b88639bcd416 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:46.587174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f452c9-5225-4b88-b7a0-b88639bcd416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:46.614244 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-28f452c9-5225-4b88-b7a0-b88639bcd416 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:46.615564 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-28f452c9-5225-4b88-b7a0-b88639bcd416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:46.648870 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:46.698554 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1421/2807] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:46.708119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a1fc7-67ea-4dc0-b99b-62ab8cdf1ad8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:46.708459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a1fc7-67ea-4dc0-b99b-62ab8cdf1ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:46.708712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a1fc7-67ea-4dc0-b99b-62ab8cdf1ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:46.729696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f27a1fc7-67ea-4dc0-b99b-62ab8cdf1ad8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:46.730934 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f27a1fc7-67ea-4dc0-b99b-62ab8cdf1ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:46.739752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1387/2808] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:46.744062 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f452c9-5225-4b88-b7a0-b88639bcd416 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:46.753936 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f452c9-5225-4b88-b7a0-b88639bcd416 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:46.758692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:46.759301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:46.759579 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:46.759851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:46.760533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:39:46.760839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:46.762809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:46.775146 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1422/2809] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:39:46.779791 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a1fc7-67ea-4dc0-b99b-62ab8cdf1ad8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:46.789491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a1fc7-67ea-4dc0-b99b-62ab8cdf1ad8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:46.794483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83bc4e-3041-4b83-aafa-5de585f3a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:46.795358 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83bc4e-3041-4b83-aafa-5de585f3a267 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:46.795694 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83bc4e-3041-4b83-aafa-5de585f3a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:46.795935 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83bc4e-3041-4b83-aafa-5de585f3a267 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:46.796961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83bc4e-3041-4b83-aafa-5de585f3a267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:46.799108 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83bc4e-3041-4b83-aafa-5de585f3a267 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:46.831136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1388/2810] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:39:46 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:39:46.835809 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:46.847900 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0ef05-fe04-41ba-9cd9-91c67883c94d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:46.918695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae302f7-7c16-46aa-b57d-e71c8a72d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:46.919738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae302f7-7c16-46aa-b57d-e71c8a72d979 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:46.919889 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae302f7-7c16-46aa-b57d-e71c8a72d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:46.920251 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae302f7-7c16-46aa-b57d-e71c8a72d979 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:46.921174 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae302f7-7c16-46aa-b57d-e71c8a72d979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:46.923572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae302f7-7c16-46aa-b57d-e71c8a72d979 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:46.964016 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1423/2811] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:39:46 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:39:46.967987 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83bc4e-3041-4b83-aafa-5de585f3a267 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:46.980824 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83bc4e-3041-4b83-aafa-5de585f3a267 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:46.986248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dc488-70a3-4f7c-9cfa-dc10936e76a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:46.986855 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc488-70a3-4f7c-9cfa-dc10936e76a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:46.987137 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc488-70a3-4f7c-9cfa-dc10936e76a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:46.987417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc488-70a3-4f7c-9cfa-dc10936e76a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:46.988077 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dc488-70a3-4f7c-9cfa-dc10936e76a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:46.989832 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dc488-70a3-4f7c-9cfa-dc10936e76a7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:47.004324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1389/2812] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:47.008303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae302f7-7c16-46aa-b57d-e71c8a72d979 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:47.021437 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae302f7-7c16-46aa-b57d-e71c8a72d979 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:47.027029 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5029f-130d-4f7f-9332-d69383a42314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:47.027647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5029f-130d-4f7f-9332-d69383a42314 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:47.027928 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5029f-130d-4f7f-9332-d69383a42314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:47.028236 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5029f-130d-4f7f-9332-d69383a42314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:47.028907 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5029f-130d-4f7f-9332-d69383a42314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:47.030574 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5029f-130d-4f7f-9332-d69383a42314 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:47.041985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1424/2813] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:39:47.046248 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dc488-70a3-4f7c-9cfa-dc10936e76a7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:47.056819 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dc488-70a3-4f7c-9cfa-dc10936e76a7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:47.062111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:47.062984 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:47.063261 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:47.063540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] PATH_INFO: `/v3/projects/b7211e778f1241ee8f0d45231d5692ae/users/22ef07385a5d444485435cb929bec787/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:47.081992 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7211e778f1241ee8f0d45231d5692ae, user_id=22ef07385a5d444485435cb929bec787, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:47.084716 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:47.101638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1390/2814] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:39:47 2022] PUT /identity/v3/projects/b7211e778f1241ee8f0d45231d5692ae/users/22ef07385a5d444485435cb929bec787/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:39:47.112346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e85d-a8f5-464e-8197-f17549bedc9a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:47.112778 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e85d-a8f5-464e-8197-f17549bedc9a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:47.113196 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748e85d-a8f5-464e-8197-f17549bedc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:47.145237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d748e85d-a8f5-464e-8197-f17549bedc9a None None] MFA Rules not processed for user `22ef07385a5d444485435cb929bec787`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:39:47.146514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d748e85d-a8f5-464e-8197-f17549bedc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:47.230077 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1425/2815] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:39:47.244281 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:39:47.246256 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:39:47.315111 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cfa4-3d8e-44ea-8984-e07980106e9e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:39:47.319426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86a7d9-4b79-4b87-bae1-643afb9d6f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:39:47.320052 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86a7d9-4b79-4b87-bae1-643afb9d6f9a service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:39:47.320324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86a7d9-4b79-4b87-bae1-643afb9d6f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:39:47.320625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86a7d9-4b79-4b87-bae1-643afb9d6f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:39:47.330301 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86a7d9-4b79-4b87-bae1-643afb9d6f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:39:47.331761 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86a7d9-4b79-4b87-bae1-643afb9d6f9a service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:39:47.342481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1391/2816] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:39:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:39:57.226076 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:39:57.338227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:15.603771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748e85d-a8f5-464e-8197-f17549bedc9a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:15.605589 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d748e85d-a8f5-464e-8197-f17549bedc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:15.675727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748e85d-a8f5-464e-8197-f17549bedc9a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:15.681068 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:15.681811 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:15.682140 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:15.682405 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] PATH_INFO: `/v3/users/9896da2adb8f43f39382a53a23a263d6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:15.683585 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9896da2adb8f43f39382a53a23a263d6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:15.685614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:15.739724 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9896da2adb8f43f39382a53a23a263d6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:15.752550 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9896da2adb8f43f39382a53a23a263d6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:15.763111 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9896da2adb8f43f39382a53a23a263d6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:15.763802 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9896da2adb8f43f39382a53a23a263d6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:15.764475 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9896da2adb8f43f39382a53a23a263d6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:15.777983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1426/2817] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:40:15 2022] DELETE /identity/v3/users/9896da2adb8f43f39382a53a23a263d6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:15.782593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e24b9-b7b0-472b-9a80-5f58b41b506c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:15.783120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e24b9-b7b0-472b-9a80-5f58b41b506c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:15.783120 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e24b9-b7b0-472b-9a80-5f58b41b506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:15.803882 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5e9e24b9-b7b0-472b-9a80-5f58b41b506c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:15.805220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5e9e24b9-b7b0-472b-9a80-5f58b41b506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:15.873197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1392/2818] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:15.893294 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:15.894807 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:15.959137 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1a67-ceb1-40b4-80d1-810bc1f6dea1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:15.963046 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9460f6-4aaf-48b6-ba51-3fb04b2e1a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:15.963672 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9460f6-4aaf-48b6-ba51-3fb04b2e1a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:15.963953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9460f6-4aaf-48b6-ba51-3fb04b2e1a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:15.964224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9460f6-4aaf-48b6-ba51-3fb04b2e1a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:15.974604 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9460f6-4aaf-48b6-ba51-3fb04b2e1a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:15.976325 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9460f6-4aaf-48b6-ba51-3fb04b2e1a04 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:15.986284 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1427/2819] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:16.279004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e24b9-b7b0-472b-9a80-5f58b41b506c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:16.280562 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5e9e24b9-b7b0-472b-9a80-5f58b41b506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:16.293852 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e24b9-b7b0-472b-9a80-5f58b41b506c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:16.299400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:16.300145 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:16.300432 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:16.300701 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] PATH_INFO: `/v3/projects/88eb629e10d54af099da1b36fc5a44b8` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:16.301916 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88eb629e10d54af099da1b36fc5a44b8)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:16.304193 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:16.354707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88eb629e10d54af099da1b36fc5a44b8', 'request_id': 'req-9fcebe90-0929-4897-aeab-01c53f2685d2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.361392 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88eb629e10d54af099da1b36fc5a44b8', 'request_id': 'req-9fcebe90-0929-4897-aeab-01c53f2685d2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.372160 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88eb629e10d54af099da1b36fc5a44b8', 'request_id': 'req-9fcebe90-0929-4897-aeab-01c53f2685d2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.383677 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] The token cache is being invalidate because project 88eb629e10d54af099da1b36fc5a44b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:40:16.383967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.384685 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.386165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1393/2820] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:40:16 2022] DELETE /identity/v3/projects/88eb629e10d54af099da1b36fc5a44b8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:16.390559 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9460f6-4aaf-48b6-ba51-3fb04b2e1a04 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:16.401863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9460f6-4aaf-48b6-ba51-3fb04b2e1a04 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:16.427006 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:16.476942 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:16.477545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:16.477826 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:16.478099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] PATH_INFO: `/v3/users/84106ed41246423d971e30c75229f793` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:16.480430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84106ed41246423d971e30c75229f793)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:16.481418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:16.548253 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84106ed41246423d971e30c75229f793'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.576005 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84106ed41246423d971e30c75229f793'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.591487 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84106ed41246423d971e30c75229f793'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.592572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84106ed41246423d971e30c75229f793'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.593461 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84106ed41246423d971e30c75229f793'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:16.610676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1428/2821] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:40:16 2022] DELETE /identity/v3/users/84106ed41246423d971e30c75229f793 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:16.899229 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:16.900775 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:16.943904 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:16.945988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:17.047845 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebe90-0929-4897-aeab-01c53f2685d2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.050700 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae99fa-e2ce-449f-b4d6-8f39fb3287a5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.055038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:17.059912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.060946 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.061397 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.061876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] PATH_INFO: `/v3/projects/0f07891b5a54449bb7912e6005daf10a` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.063717 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f07891b5a54449bb7912e6005daf10a)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.068664 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.136064 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:17.141751 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f07891b5a54449bb7912e6005daf10a', 'request_id': 'req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:17.152788 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f07891b5a54449bb7912e6005daf10a', 'request_id': 'req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:17.153924 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034802b6-5259-46a6-9e01-70e7b0cd0fb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.154698 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034802b6-5259-46a6-9e01-70e7b0cd0fb8 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.155061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034802b6-5259-46a6-9e01-70e7b0cd0fb8 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.155334 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034802b6-5259-46a6-9e01-70e7b0cd0fb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.157607 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-034802b6-5259-46a6-9e01-70e7b0cd0fb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:17.161755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f07891b5a54449bb7912e6005daf10a', 'request_id': 'req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:17.173759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034802b6-5259-46a6-9e01-70e7b0cd0fb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.176006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034802b6-5259-46a6-9e01-70e7b0cd0fb8 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.179142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] The token cache is being invalidate because project 0f07891b5a54449bb7912e6005daf10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:40:17.179142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:17.185492 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6b9b6b49-7f7e-4c72-afa2-b6a5027409bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:17.191049 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1429/2822] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:40:16 2022] DELETE /identity/v3/projects/0f07891b5a54449bb7912e6005daf10a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:40:17.191207 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1394/2823] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:17.192608 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380ee7-0bc0-4bc7-80df-c0ad59707647 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.192896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380ee7-0bc0-4bc7-80df-c0ad59707647 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.193166 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380ee7-0bc0-4bc7-80df-c0ad59707647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.214286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3e380ee7-0bc0-4bc7-80df-c0ad59707647 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:17.215528 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3e380ee7-0bc0-4bc7-80df-c0ad59707647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:17.279663 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1430/2824] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:17.288269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ab145-40a4-4275-acd1-999930768b4c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.288544 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ab145-40a4-4275-acd1-999930768b4c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.289081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ab145-40a4-4275-acd1-999930768b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.310573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0a6ab145-40a4-4275-acd1-999930768b4c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:17.312017 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0a6ab145-40a4-4275-acd1-999930768b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:17.320903 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1395/2825] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:17.325478 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380ee7-0bc0-4bc7-80df-c0ad59707647 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:17.335639 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380ee7-0bc0-4bc7-80df-c0ad59707647 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.340366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.341007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.341287 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.341584 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.342245 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:40:17.342551 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.344180 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.356277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1431/2826] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:40:17.362360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ab145-40a4-4275-acd1-999930768b4c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:17.373318 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ab145-40a4-4275-acd1-999930768b4c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.379027 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ed36a-6312-4766-b052-cd2cd95784d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.379638 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ed36a-6312-4766-b052-cd2cd95784d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.379917 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ed36a-6312-4766-b052-cd2cd95784d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.380187 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ed36a-6312-4766-b052-cd2cd95784d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.380869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ed36a-6312-4766-b052-cd2cd95784d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.383339 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ed36a-6312-4766-b052-cd2cd95784d7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.422954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1396/2827] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:40:17 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:40:17.427925 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:17.439207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbc7ef-1c94-43cc-ade1-aa9afc135eae admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.505623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7826-706e-4cdb-8ff1-7f7d189a73cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.506283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7826-706e-4cdb-8ff1-7f7d189a73cc admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.506689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7826-706e-4cdb-8ff1-7f7d189a73cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.506998 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7826-706e-4cdb-8ff1-7f7d189a73cc admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.507635 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e7826-706e-4cdb-8ff1-7f7d189a73cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.509612 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e7826-706e-4cdb-8ff1-7f7d189a73cc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.548084 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1432/2828] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:40:17 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:17.553117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ed36a-6312-4766-b052-cd2cd95784d7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:17.563927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ed36a-6312-4766-b052-cd2cd95784d7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.574760 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08270e-a33a-40ed-8152-7afc7ce4df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.575492 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08270e-a33a-40ed-8152-7afc7ce4df59 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.575800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08270e-a33a-40ed-8152-7afc7ce4df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.576101 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08270e-a33a-40ed-8152-7afc7ce4df59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.576946 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08270e-a33a-40ed-8152-7afc7ce4df59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.578506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08270e-a33a-40ed-8152-7afc7ce4df59 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.590806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1397/2829] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:40:17.595586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7826-706e-4cdb-8ff1-7f7d189a73cc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:17.608591 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7826-706e-4cdb-8ff1-7f7d189a73cc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.613542 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43e582-df79-4c05-9866-5719b96019b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.614194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e582-df79-4c05-9866-5719b96019b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.614458 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e582-df79-4c05-9866-5719b96019b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.614731 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e582-df79-4c05-9866-5719b96019b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.615379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43e582-df79-4c05-9866-5719b96019b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.618252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43e582-df79-4c05-9866-5719b96019b7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.630386 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1433/2830] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:17.635689 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08270e-a33a-40ed-8152-7afc7ce4df59 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:17.648098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08270e-a33a-40ed-8152-7afc7ce4df59 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.653717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be2907-5746-441a-9121-d05ca3ce66e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.654390 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2907-5746-441a-9121-d05ca3ce66e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.654669 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2907-5746-441a-9121-d05ca3ce66e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.654943 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2907-5746-441a-9121-d05ca3ce66e2 admin admin] PATH_INFO: `/v3/projects/6eed5473a359446b84e584a8ea7cdaf5/users/b2185c48e7a64f0d941d59071f78304e/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.672192 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be2907-5746-441a-9121-d05ca3ce66e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eed5473a359446b84e584a8ea7cdaf5, user_id=b2185c48e7a64f0d941d59071f78304e, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.674962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be2907-5746-441a-9121-d05ca3ce66e2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.690221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1398/2831] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:40:17 2022] PUT /identity/v3/projects/6eed5473a359446b84e584a8ea7cdaf5/users/b2185c48e7a64f0d941d59071f78304e/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:40:17.702927 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d8bf-445e-4ff9-bf95-25082bd515b3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.703230 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d8bf-445e-4ff9-bf95-25082bd515b3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.703468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d8bf-445e-4ff9-bf95-25082bd515b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.733222 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b901d8bf-445e-4ff9-bf95-25082bd515b3 None None] MFA Rules not processed for user `b2185c48e7a64f0d941d59071f78304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:17.734453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b901d8bf-445e-4ff9-bf95-25082bd515b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:17.768160 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:17.822314 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1434/2832] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:17.822418 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be2907-5746-441a-9121-d05ca3ce66e2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:17.905666 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be2907-5746-441a-9121-d05ca3ce66e2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:17.911488 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d311d-d842-4236-b115-e5a5b32d4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:17.912298 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d311d-d842-4236-b115-e5a5b32d4006 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:17.912826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d311d-d842-4236-b115-e5a5b32d4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:17.913891 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d311d-d842-4236-b115-e5a5b32d4006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:17.914650 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d311d-d842-4236-b115-e5a5b32d4006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:17.916781 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d311d-d842-4236-b115-e5a5b32d4006 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:17.950471 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1399/2833] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:40:17 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:17.957449 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d8bf-445e-4ff9-bf95-25082bd515b3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:17.971130 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d8bf-445e-4ff9-bf95-25082bd515b3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:18.036093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9d65-513c-48c7-b4b7-40195a72e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:18.036824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9d65-513c-48c7-b4b7-40195a72e6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:18.037104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9d65-513c-48c7-b4b7-40195a72e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:18.037376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9d65-513c-48c7-b4b7-40195a72e6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:18.038610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9d65-513c-48c7-b4b7-40195a72e6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:18.040629 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9d65-513c-48c7-b4b7-40195a72e6a7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:18.065418 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1435/2834] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:40:17 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:40:18.069452 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d311d-d842-4236-b115-e5a5b32d4006 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:18.080655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d311d-d842-4236-b115-e5a5b32d4006 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:18.086292 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d92ea-b1b5-4fd0-8476-e39344b7a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:18.086912 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d92ea-b1b5-4fd0-8476-e39344b7a427 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:18.087190 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d92ea-b1b5-4fd0-8476-e39344b7a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:18.087459 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d92ea-b1b5-4fd0-8476-e39344b7a427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:18.088280 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d92ea-b1b5-4fd0-8476-e39344b7a427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:18.090036 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d92ea-b1b5-4fd0-8476-e39344b7a427 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:18.102759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1400/2835] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:18.107221 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9d65-513c-48c7-b4b7-40195a72e6a7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:18.118173 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9d65-513c-48c7-b4b7-40195a72e6a7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:18.123366 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972f3d5-2ae4-456b-9eec-89aba3edc65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:18.124045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972f3d5-2ae4-456b-9eec-89aba3edc65e admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:18.124337 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972f3d5-2ae4-456b-9eec-89aba3edc65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:18.124627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972f3d5-2ae4-456b-9eec-89aba3edc65e admin admin] PATH_INFO: `/v3/projects/3ff95ffc9cf4449db6c6d80c108b7907/users/6e49f170d27a4f5887acf6d0f873fb4d/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:18.141893 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972f3d5-2ae4-456b-9eec-89aba3edc65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff95ffc9cf4449db6c6d80c108b7907, user_id=6e49f170d27a4f5887acf6d0f873fb4d, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:18.144691 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972f3d5-2ae4-456b-9eec-89aba3edc65e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:18.166067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1436/2836] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:40:18 2022] PUT /identity/v3/projects/3ff95ffc9cf4449db6c6d80c108b7907/users/6e49f170d27a4f5887acf6d0f873fb4d/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:18.170673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d92ea-b1b5-4fd0-8476-e39344b7a427 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:18.182980 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d92ea-b1b5-4fd0-8476-e39344b7a427 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:18.187596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:18.254744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c15eea-400a-4ff3-8a54-cd6f04fd0758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:18.255373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c15eea-400a-4ff3-8a54-cd6f04fd0758 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:18.255654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c15eea-400a-4ff3-8a54-cd6f04fd0758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:18.255926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c15eea-400a-4ff3-8a54-cd6f04fd0758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:18.257272 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c15eea-400a-4ff3-8a54-cd6f04fd0758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:18.258897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c15eea-400a-4ff3-8a54-cd6f04fd0758 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:18.271799 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1401/2837] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:18.275983 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972f3d5-2ae4-456b-9eec-89aba3edc65e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:18.286890 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972f3d5-2ae4-456b-9eec-89aba3edc65e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:18.293552 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:18.294310 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:18.294708 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:18.295039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] PATH_INFO: `/v3/projects/3ff95ffc9cf4449db6c6d80c108b7907/users/6e49f170d27a4f5887acf6d0f873fb4d/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:18.297806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff95ffc9cf4449db6c6d80c108b7907, user_id=6e49f170d27a4f5887acf6d0f873fb4d, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:18.301373 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:18.313535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1437/2838] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:40:18 2022] PUT /identity/v3/projects/3ff95ffc9cf4449db6c6d80c108b7907/users/6e49f170d27a4f5887acf6d0f873fb4d/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:18.323947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb05de8-6105-4061-bee4-84c4adc9f776 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:18.324139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb05de8-6105-4061-bee4-84c4adc9f776 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:18.324438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb05de8-6105-4061-bee4-84c4adc9f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:18.358090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0fb05de8-6105-4061-bee4-84c4adc9f776 None None] MFA Rules not processed for user `6e49f170d27a4f5887acf6d0f873fb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:18.359516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0fb05de8-6105-4061-bee4-84c4adc9f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:18.447022 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1402/2839] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:18.458538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:18.461079 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:18.521460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097abdc-ae8d-4bea-8d88-99130f64e6e2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:18.526789 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:18.527423 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:18.527698 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:18.527978 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:18.541028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:18.542523 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:18.552859 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1438/2840] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:18.650241 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb05de8-6105-4061-bee4-84c4adc9f776 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:18.664308 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb05de8-6105-4061-bee4-84c4adc9f776 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:18.669774 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2f573-4533-40a1-8a25-d22dc4e1bcbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:18.670618 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2f573-4533-40a1-8a25-d22dc4e1bcbe service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:18.670764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2f573-4533-40a1-8a25-d22dc4e1bcbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:18.670931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2f573-4533-40a1-8a25-d22dc4e1bcbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:18.738341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2f573-4533-40a1-8a25-d22dc4e1bcbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:18.739803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2f573-4533-40a1-8a25-d22dc4e1bcbe service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:18.749254 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1403/2841] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:18.992945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:18.995329 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:19.033286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:19.079989 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc396d1-fc1c-4e79-8415-a9ffbab082e4 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:19.086676 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:19.087520 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:19.087891 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:19.088167 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] PATH_INFO: `/v3/users/22ef07385a5d444485435cb929bec787` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:19.089638 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ef07385a5d444485435cb929bec787)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:19.092661 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:19.152090 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ef07385a5d444485435cb929bec787'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.164824 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ef07385a5d444485435cb929bec787'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.176642 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ef07385a5d444485435cb929bec787'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.177484 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ef07385a5d444485435cb929bec787'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.178169 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ef07385a5d444485435cb929bec787'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.191382 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1439/2842] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:40:18 2022] DELETE /identity/v3/users/22ef07385a5d444485435cb929bec787 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:19.196498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fa3b-2bb5-4a1a-9f4a-c93c4311851c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:19.197258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fa3b-2bb5-4a1a-9f4a-c93c4311851c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:19.197258 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14fa3b-2bb5-4a1a-9f4a-c93c4311851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:19.217425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-aa14fa3b-2bb5-4a1a-9f4a-c93c4311851c None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:19.218667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-aa14fa3b-2bb5-4a1a-9f4a-c93c4311851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:19.240869 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:19.282252 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1404/2843] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:19.293491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:19.295104 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:19.358914 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901148e-afda-4f7a-ad93-06658fb4cbeb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:19.362786 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:19.363402 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:19.363709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:19.363988 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:19.373987 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:19.375444 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:19.385448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1440/2844] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:19.697355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14fa3b-2bb5-4a1a-9f4a-c93c4311851c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:19.699889 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-aa14fa3b-2bb5-4a1a-9f4a-c93c4311851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:19.714141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14fa3b-2bb5-4a1a-9f4a-c93c4311851c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:19.720593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:19.721257 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:19.721540 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:19.721814 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] PATH_INFO: `/v3/projects/b7211e778f1241ee8f0d45231d5692ae` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:19.723126 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7211e778f1241ee8f0d45231d5692ae)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:19.725122 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:19.779182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7211e778f1241ee8f0d45231d5692ae', 'request_id': 'req-62b4c990-f542-4ca7-9da7-3e40bf11ef56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.785744 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7211e778f1241ee8f0d45231d5692ae', 'request_id': 'req-62b4c990-f542-4ca7-9da7-3e40bf11ef56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.795222 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7211e778f1241ee8f0d45231d5692ae', 'request_id': 'req-62b4c990-f542-4ca7-9da7-3e40bf11ef56'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.806070 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] The token cache is being invalidate because project b7211e778f1241ee8f0d45231d5692ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:40:19.806363 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.807032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-62b4c990-f542-4ca7-9da7-3e40bf11ef56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:19.809002 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1405/2845] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:40:19 2022] DELETE /identity/v3/projects/b7211e778f1241ee8f0d45231d5692ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:40:21.551514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:21.553136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:21.566958 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706b662-2ad0-46ca-b3b2-74bf999df67c service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:21.614065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:21.636730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:21.638069 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:21.638350 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:21.638634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] PATH_INFO: `/v3/users/b2185c48e7a64f0d941d59071f78304e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:21.639926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2185c48e7a64f0d941d59071f78304e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:21.641904 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:21.701688 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2185c48e7a64f0d941d59071f78304e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:21.714427 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2185c48e7a64f0d941d59071f78304e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:21.724488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2185c48e7a64f0d941d59071f78304e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:21.725162 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2185c48e7a64f0d941d59071f78304e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:21.725873 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2185c48e7a64f0d941d59071f78304e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:21.738851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1441/2846] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:40:21 2022] DELETE /identity/v3/users/b2185c48e7a64f0d941d59071f78304e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:21.743715 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f253c6-6382-435d-ae9d-66f1bf466893 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:21.744216 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f253c6-6382-435d-ae9d-66f1bf466893 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:21.744355 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f253c6-6382-435d-ae9d-66f1bf466893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:21.764365 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-63f253c6-6382-435d-ae9d-66f1bf466893 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:21.765612 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-63f253c6-6382-435d-ae9d-66f1bf466893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:21.828102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1406/2847] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:21.838252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:21.839755 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:21.903647 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d19c7a-1534-4ac4-a812-5374bf6fa693 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:21.907597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dfa47-e92f-436a-8ce3-5936bcd6e15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:21.908301 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dfa47-e92f-436a-8ce3-5936bcd6e15c service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:21.908614 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dfa47-e92f-436a-8ce3-5936bcd6e15c service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:21.908888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dfa47-e92f-436a-8ce3-5936bcd6e15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:21.919171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dfa47-e92f-436a-8ce3-5936bcd6e15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:21.920709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dfa47-e92f-436a-8ce3-5936bcd6e15c service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:21.930899 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1442/2848] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:22.228904 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f253c6-6382-435d-ae9d-66f1bf466893 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:22.230484 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-63f253c6-6382-435d-ae9d-66f1bf466893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:22.248866 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f253c6-6382-435d-ae9d-66f1bf466893 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:22.255273 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:22.256438 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:22.256873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:22.257373 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] PATH_INFO: `/v3/projects/6eed5473a359446b84e584a8ea7cdaf5` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:22.259622 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eed5473a359446b84e584a8ea7cdaf5)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:22.263682 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:22.323324 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:22.326637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eed5473a359446b84e584a8ea7cdaf5', 'request_id': 'req-227bc2db-084d-4d2c-8c62-8d92b635980a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.334616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eed5473a359446b84e584a8ea7cdaf5', 'request_id': 'req-227bc2db-084d-4d2c-8c62-8d92b635980a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.344233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eed5473a359446b84e584a8ea7cdaf5', 'request_id': 'req-227bc2db-084d-4d2c-8c62-8d92b635980a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.356911 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] The token cache is being invalidate because project 6eed5473a359446b84e584a8ea7cdaf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:40:22.357208 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.357953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.359757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1407/2849] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:40:22 2022] DELETE /identity/v3/projects/6eed5473a359446b84e584a8ea7cdaf5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:40:22.364580 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dfa47-e92f-436a-8ce3-5936bcd6e15c service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:22.378974 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dfa47-e92f-436a-8ce3-5936bcd6e15c service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:22.442746 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:22.443388 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:22.443684 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:22.443945 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] PATH_INFO: `/v3/users/6e49f170d27a4f5887acf6d0f873fb4d` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:22.445112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e49f170d27a4f5887acf6d0f873fb4d)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:22.447093 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:22.453721 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:22.503087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e49f170d27a4f5887acf6d0f873fb4d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.518689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e49f170d27a4f5887acf6d0f873fb4d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.531210 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e49f170d27a4f5887acf6d0f873fb4d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.531926 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e49f170d27a4f5887acf6d0f873fb4d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.532872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a124bcd-292c-4ae9-b27d-4df5ab904d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e49f170d27a4f5887acf6d0f873fb4d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:22.549237 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1443/2850] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:40:22 2022] DELETE /identity/v3/users/6e49f170d27a4f5887acf6d0f873fb4d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:22.997961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:22.999435 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:23.024217 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bc2db-084d-4d2c-8c62-8d92b635980a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:23.105203 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:23.106323 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.106807 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.107333 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] PATH_INFO: `/v3/projects/3ff95ffc9cf4449db6c6d80c108b7907` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.108739 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff95ffc9cf4449db6c6d80c108b7907)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:23.110919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:23.170102 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff95ffc9cf4449db6c6d80c108b7907', 'request_id': 'req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:23.176967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff95ffc9cf4449db6c6d80c108b7907', 'request_id': 'req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:23.186491 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff95ffc9cf4449db6c6d80c108b7907', 'request_id': 'req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:23.198008 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] The token cache is being invalidate because project 3ff95ffc9cf4449db6c6d80c108b7907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:40:23.198451 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:23.199170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a95d14e9-e8ae-40e0-bb2f-c1aae6c986f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:23.200956 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1408/2851] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:40:22 2022] DELETE /identity/v3/projects/3ff95ffc9cf4449db6c6d80c108b7907 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:23.205836 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c6327-a829-4668-8492-e31eb9b0c769 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.206352 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c6327-a829-4668-8492-e31eb9b0c769 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.206480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c6327-a829-4668-8492-e31eb9b0c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.226801 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e45c6327-a829-4668-8492-e31eb9b0c769 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:23.228159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e45c6327-a829-4668-8492-e31eb9b0c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:23.292611 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1444/2852] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:23.302983 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5dcb-aeb6-41c2-9ec8-37eb50cb054a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.303275 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5dcb-aeb6-41c2-9ec8-37eb50cb054a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.303550 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5dcb-aeb6-41c2-9ec8-37eb50cb054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.330573 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-00af5dcb-aeb6-41c2-9ec8-37eb50cb054a None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:23.331812 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-00af5dcb-aeb6-41c2-9ec8-37eb50cb054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:23.340091 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1409/2853] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:23.345220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c6327-a829-4668-8492-e31eb9b0c769 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:23.356215 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c6327-a829-4668-8492-e31eb9b0c769 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:23.361127 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:23.361869 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.362142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.362410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.363081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:40:23.363377 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:23.365014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:23.377748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1445/2854] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:40:23.384138 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af5dcb-aeb6-41c2-9ec8-37eb50cb054a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:23.395354 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af5dcb-aeb6-41c2-9ec8-37eb50cb054a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:23.402072 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93c61-67e4-4ca4-8c9c-d1ad2cac06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:23.402759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93c61-67e4-4ca4-8c9c-d1ad2cac06f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.403154 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93c61-67e4-4ca4-8c9c-d1ad2cac06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.403626 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93c61-67e4-4ca4-8c9c-d1ad2cac06f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.404658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93c61-67e4-4ca4-8c9c-d1ad2cac06f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:23.407015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93c61-67e4-4ca4-8c9c-d1ad2cac06f4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:23.441874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1410/2855] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:40:23 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:23.448061 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:23.461776 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a693c-dadf-4963-8383-a37476c89837 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:23.523453 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc905-5674-4e45-b690-9d827a2378e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:23.524066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc905-5674-4e45-b690-9d827a2378e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.524379 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc905-5674-4e45-b690-9d827a2378e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.524681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc905-5674-4e45-b690-9d827a2378e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.525322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdc905-5674-4e45-b690-9d827a2378e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:23.527322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdc905-5674-4e45-b690-9d827a2378e4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:23.554771 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1446/2856] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:40:23 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:23.559967 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93c61-67e4-4ca4-8c9c-d1ad2cac06f4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:23.575649 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93c61-67e4-4ca4-8c9c-d1ad2cac06f4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:23.584139 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d92f2-1e83-42d1-ba07-436d4d69883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:23.585081 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d92f2-1e83-42d1-ba07-436d4d69883c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.585736 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d92f2-1e83-42d1-ba07-436d4d69883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.586015 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d92f2-1e83-42d1-ba07-436d4d69883c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.587211 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d92f2-1e83-42d1-ba07-436d4d69883c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:23.589877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d92f2-1e83-42d1-ba07-436d4d69883c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:23.604021 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1411/2857] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:23.609595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc905-5674-4e45-b690-9d827a2378e4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:23.617208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:23.626313 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc905-5674-4e45-b690-9d827a2378e4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:23.634910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edbdf0-1df1-47b1-b44c-062f87819ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:23.635538 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbdf0-1df1-47b1-b44c-062f87819ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.635816 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbdf0-1df1-47b1-b44c-062f87819ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.636091 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edbdf0-1df1-47b1-b44c-062f87819ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.636803 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edbdf0-1df1-47b1-b44c-062f87819ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:23.638999 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edbdf0-1df1-47b1-b44c-062f87819ddf admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:23.650993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1447/2858] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:23.656672 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d92f2-1e83-42d1-ba07-436d4d69883c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:23.667472 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d92f2-1e83-42d1-ba07-436d4d69883c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:23.672861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1e94-1954-4a64-8ca9-39aabd85ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:23.673553 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1e94-1954-4a64-8ca9-39aabd85ba06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.673835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1e94-1954-4a64-8ca9-39aabd85ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.674115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1e94-1954-4a64-8ca9-39aabd85ba06 admin admin] PATH_INFO: `/v3/projects/0a5739df14014dd4af0e13ef08559e5d/users/25e768845ce84eb8a53fecec427b1898/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.691673 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de1e94-1954-4a64-8ca9-39aabd85ba06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5739df14014dd4af0e13ef08559e5d, user_id=25e768845ce84eb8a53fecec427b1898, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:23.695034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de1e94-1954-4a64-8ca9-39aabd85ba06 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:23.707082 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:23.713128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1412/2859] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:40:23 2022] PUT /identity/v3/projects/0a5739df14014dd4af0e13ef08559e5d/users/25e768845ce84eb8a53fecec427b1898/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:40:23.726806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c12dfa-f4c7-4f46-b4ed-7b4112866b8b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.727184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c12dfa-f4c7-4f46-b4ed-7b4112866b8b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.727512 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c12dfa-f4c7-4f46-b4ed-7b4112866b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.763282 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-52c12dfa-f4c7-4f46-b4ed-7b4112866b8b None None] MFA Rules not processed for user `25e768845ce84eb8a53fecec427b1898`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:23.764547 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-52c12dfa-f4c7-4f46-b4ed-7b4112866b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:23.833993 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1448/2860] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:40:23.839483 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1e94-1954-4a64-8ca9-39aabd85ba06 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:23.910588 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1e94-1954-4a64-8ca9-39aabd85ba06 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:23.917709 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef020c4-03ad-48a5-bc87-c5678bd0932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:23.918625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef020c4-03ad-48a5-bc87-c5678bd0932e admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:23.919010 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef020c4-03ad-48a5-bc87-c5678bd0932e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:23.919481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef020c4-03ad-48a5-bc87-c5678bd0932e admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:23.920057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef020c4-03ad-48a5-bc87-c5678bd0932e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:23.922044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef020c4-03ad-48a5-bc87-c5678bd0932e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:23.953597 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1413/2861] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:40:23 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:23.959178 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c12dfa-f4c7-4f46-b4ed-7b4112866b8b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:23.975091 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c12dfa-f4c7-4f46-b4ed-7b4112866b8b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:24.176254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be384a68-6983-42ee-b92e-0f3abe83894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:24.176916 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384a68-6983-42ee-b92e-0f3abe83894e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:24.177188 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384a68-6983-42ee-b92e-0f3abe83894e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:24.177459 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be384a68-6983-42ee-b92e-0f3abe83894e admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:24.178193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be384a68-6983-42ee-b92e-0f3abe83894e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:24.180159 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be384a68-6983-42ee-b92e-0f3abe83894e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:24.205375 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1449/2862] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:40:23 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:24.209425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef020c4-03ad-48a5-bc87-c5678bd0932e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:24.220940 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef020c4-03ad-48a5-bc87-c5678bd0932e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:24.226428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487676e-fd67-48e2-b992-4a1e83a32097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:24.227128 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487676e-fd67-48e2-b992-4a1e83a32097 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:24.227478 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487676e-fd67-48e2-b992-4a1e83a32097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:24.227816 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487676e-fd67-48e2-b992-4a1e83a32097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:24.228567 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487676e-fd67-48e2-b992-4a1e83a32097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:24.230244 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487676e-fd67-48e2-b992-4a1e83a32097 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:24.243400 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1414/2863] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:24.248501 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be384a68-6983-42ee-b92e-0f3abe83894e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:24.259446 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be384a68-6983-42ee-b92e-0f3abe83894e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:24.265448 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833a5f3-7780-4a36-9023-03c674e046aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:24.266229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a5f3-7780-4a36-9023-03c674e046aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:24.266567 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a5f3-7780-4a36-9023-03c674e046aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:24.266924 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a5f3-7780-4a36-9023-03c674e046aa admin admin] PATH_INFO: `/v3/projects/448b0bc3e1f345cfa5b0213d6fbfc709/users/70f47367852e4d9b9aebd4f40dedeafa/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:24.283443 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833a5f3-7780-4a36-9023-03c674e046aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=448b0bc3e1f345cfa5b0213d6fbfc709, user_id=70f47367852e4d9b9aebd4f40dedeafa, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:24.286241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833a5f3-7780-4a36-9023-03c674e046aa admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:24.302383 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1450/2864] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:40:24 2022] PUT /identity/v3/projects/448b0bc3e1f345cfa5b0213d6fbfc709/users/70f47367852e4d9b9aebd4f40dedeafa/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:24.306243 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487676e-fd67-48e2-b992-4a1e83a32097 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:24.316835 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487676e-fd67-48e2-b992-4a1e83a32097 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:24.374240 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f5a21-adeb-429b-a093-6a973cb01ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:24.374861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5a21-adeb-429b-a093-6a973cb01ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:24.375150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5a21-adeb-429b-a093-6a973cb01ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:24.375426 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5a21-adeb-429b-a093-6a973cb01ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:24.376078 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f5a21-adeb-429b-a093-6a973cb01ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:24.377726 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f5a21-adeb-429b-a093-6a973cb01ee7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:24.387982 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1415/2865] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:24.392754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833a5f3-7780-4a36-9023-03c674e046aa admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:24.403531 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833a5f3-7780-4a36-9023-03c674e046aa admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:24.408970 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:24.409630 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:24.409901 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:24.410171 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] PATH_INFO: `/v3/projects/448b0bc3e1f345cfa5b0213d6fbfc709/users/70f47367852e4d9b9aebd4f40dedeafa/roles/e4f990a9ab47493cb9a9e93707363f32` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:24.412151 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448b0bc3e1f345cfa5b0213d6fbfc709, user_id=70f47367852e4d9b9aebd4f40dedeafa, role_id=e4f990a9ab47493cb9a9e93707363f32)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:24.414877 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:24.427015 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1451/2866] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:40:24 2022] PUT /identity/v3/projects/448b0bc3e1f345cfa5b0213d6fbfc709/users/70f47367852e4d9b9aebd4f40dedeafa/roles/e4f990a9ab47493cb9a9e93707363f32 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:24.438279 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941053d-ae9e-4dea-98c9-f1f049748a3c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:24.438559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941053d-ae9e-4dea-98c9-f1f049748a3c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:24.438884 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941053d-ae9e-4dea-98c9-f1f049748a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:24.472341 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9941053d-ae9e-4dea-98c9-f1f049748a3c None None] MFA Rules not processed for user `70f47367852e4d9b9aebd4f40dedeafa`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:24.473521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9941053d-ae9e-4dea-98c9-f1f049748a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:24.537456 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:24.547978 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1416/2867] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:24.560865 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:24.562667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:24.602785 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:24.630852 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e1dac-94e3-4a34-8fd4-79aff93e94b9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:24.634835 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:24.635447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:24.635730 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:24.636001 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:24.646351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:24.647798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:24.659023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1452/2868] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:40:24.752117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941053d-ae9e-4dea-98c9-f1f049748a3c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:24.762768 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941053d-ae9e-4dea-98c9-f1f049748a3c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:24.773950 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:24.774840 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:24.775328 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:24.775995 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:24.842662 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:24.844378 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:24.854763 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1417/2869] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:25.714793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:25.716351 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:25.776271 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bfc8f-1623-4765-a0ae-348c55efb06a service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:25.779822 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:25.780460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:25.780737 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:25.781007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:25.782745 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:25.792866 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:25.794508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:25.802819 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1453/2870] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:25.902525 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:25.904304 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:25.917470 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a9c11-501e-435e-90e3-ce14a31b495b service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:25.922481 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da962f1-738e-46c6-9250-4fc778836f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:25.923100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da962f1-738e-46c6-9250-4fc778836f3f service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:25.923385 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da962f1-738e-46c6-9250-4fc778836f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:25.923655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da962f1-738e-46c6-9250-4fc778836f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:25.925789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3da962f1-738e-46c6-9250-4fc778836f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:26.026431 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da962f1-738e-46c6-9250-4fc778836f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:26.027764 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da962f1-738e-46c6-9250-4fc778836f3f service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:26.050616 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1418/2871] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:29.806477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:29.879406 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb44225-d306-4b10-9ae8-70e00c7f6e20 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:29.884583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:29.885239 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:29.885513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:29.885783 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] PATH_INFO: `/v3/users/25e768845ce84eb8a53fecec427b1898` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:29.887380 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e768845ce84eb8a53fecec427b1898)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:29.889309 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:29.942624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e768845ce84eb8a53fecec427b1898'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:29.956299 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e768845ce84eb8a53fecec427b1898'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:29.965599 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e768845ce84eb8a53fecec427b1898'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:29.966261 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e768845ce84eb8a53fecec427b1898'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:29.966906 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e768845ce84eb8a53fecec427b1898'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:29.976505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:29.983941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1454/2872] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:40:29 2022] DELETE /identity/v3/users/25e768845ce84eb8a53fecec427b1898 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:29.989417 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a619-4ab9-4ea8-9bdd-00feef0f70c3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:29.989947 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a619-4ab9-4ea8-9bdd-00feef0f70c3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:29.990056 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a619-4ab9-4ea8-9bdd-00feef0f70c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:30.009655 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ea62a619-4ab9-4ea8-9bdd-00feef0f70c3 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:30.010875 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ea62a619-4ab9-4ea8-9bdd-00feef0f70c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:30.066838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:30.081973 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1419/2873] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:30.092193 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:30.094840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:30.160376 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea4627-010b-4e38-98c7-77bb88ce02ef admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:30.164880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e4f5-6081-4178-a922-6737540c0d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:30.165535 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e4f5-6081-4178-a922-6737540c0d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:30.165812 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e4f5-6081-4178-a922-6737540c0d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:30.166854 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e4f5-6081-4178-a922-6737540c0d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:30.177941 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12e4f5-6081-4178-a922-6737540c0d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:30.179742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12e4f5-6081-4178-a922-6737540c0d20 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:30.191081 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1455/2874] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:40:30.482079 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a619-4ab9-4ea8-9bdd-00feef0f70c3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:30.485227 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ea62a619-4ab9-4ea8-9bdd-00feef0f70c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:30.504582 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a619-4ab9-4ea8-9bdd-00feef0f70c3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:30.511112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:30.512425 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:30.512899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:30.513285 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] PATH_INFO: `/v3/projects/0a5739df14014dd4af0e13ef08559e5d` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:30.514712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5739df14014dd4af0e13ef08559e5d)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:30.517330 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:30.569755 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5739df14014dd4af0e13ef08559e5d', 'request_id': 'req-e91702c6-dfa9-4546-94ab-4cf69fbcc764'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.579157 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5739df14014dd4af0e13ef08559e5d', 'request_id': 'req-e91702c6-dfa9-4546-94ab-4cf69fbcc764'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.588651 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5739df14014dd4af0e13ef08559e5d', 'request_id': 'req-e91702c6-dfa9-4546-94ab-4cf69fbcc764'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.599615 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] The token cache is being invalidate because project 0a5739df14014dd4af0e13ef08559e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:40:30.599907 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.600604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.602098 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1420/2875] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:40:30 2022] DELETE /identity/v3/projects/0a5739df14014dd4af0e13ef08559e5d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:30.606191 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e4f5-6081-4178-a922-6737540c0d20 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:30.617254 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e4f5-6081-4178-a922-6737540c0d20 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:30.675087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:30.675750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:30.676025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:30.676292 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] PATH_INFO: `/v3/users/70f47367852e4d9b9aebd4f40dedeafa` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:30.677473 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f47367852e4d9b9aebd4f40dedeafa)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:30.679415 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:30.728923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f47367852e4d9b9aebd4f40dedeafa'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.741537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f47367852e4d9b9aebd4f40dedeafa'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.754362 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f47367852e4d9b9aebd4f40dedeafa'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.755208 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f47367852e4d9b9aebd4f40dedeafa'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.756150 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c11e833a-0ca4-4e4e-9491-b0be227a9a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f47367852e4d9b9aebd4f40dedeafa'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:30.772252 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1456/2876] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:40:30 2022] DELETE /identity/v3/users/70f47367852e4d9b9aebd4f40dedeafa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:31.050990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:31.052667 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:31.068789 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91702c6-dfa9-4546-94ab-4cf69fbcc764 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:31.133800 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:31.134527 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.134809 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.135095 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] PATH_INFO: `/v3/projects/448b0bc3e1f345cfa5b0213d6fbfc709` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.136259 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=448b0bc3e1f345cfa5b0213d6fbfc709)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:31.138549 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:31.192902 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448b0bc3e1f345cfa5b0213d6fbfc709', 'request_id': 'req-bba69a79-224d-4f12-9b0c-13804f036bdb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:31.199707 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448b0bc3e1f345cfa5b0213d6fbfc709', 'request_id': 'req-bba69a79-224d-4f12-9b0c-13804f036bdb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:31.210665 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448b0bc3e1f345cfa5b0213d6fbfc709', 'request_id': 'req-bba69a79-224d-4f12-9b0c-13804f036bdb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:31.222204 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] The token cache is being invalidate because project 448b0bc3e1f345cfa5b0213d6fbfc709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:40:31.222522 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:31.223165 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bba69a79-224d-4f12-9b0c-13804f036bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:31.224717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1421/2877] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:40:31 2022] DELETE /identity/v3/projects/448b0bc3e1f345cfa5b0213d6fbfc709 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:31.229875 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399b9e-9d52-4dca-90f0-14c12763db04 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.230396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399b9e-9d52-4dca-90f0-14c12763db04 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.230396 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399b9e-9d52-4dca-90f0-14c12763db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.251303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5f399b9e-9d52-4dca-90f0-14c12763db04 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:31.252583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5f399b9e-9d52-4dca-90f0-14c12763db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:31.267326 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:31.318441 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1457/2878] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:31.331034 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54da21-5d4b-401b-b13d-2ce0e1dd0539 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.331412 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54da21-5d4b-401b-b13d-2ce0e1dd0539 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.331730 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54da21-5d4b-401b-b13d-2ce0e1dd0539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.349368 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:31.355631 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3f54da21-5d4b-401b-b13d-2ce0e1dd0539 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:31.357386 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3f54da21-5d4b-401b-b13d-2ce0e1dd0539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:31.368225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1422/2879] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:31.372931 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f399b9e-9d52-4dca-90f0-14c12763db04 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:31.385288 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f399b9e-9d52-4dca-90f0-14c12763db04 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:31.392430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:31.393228 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.393502 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.393763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.394410 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:40:31.394707 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:31.396358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:31.410595 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1458/2880] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:40:31.416255 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54da21-5d4b-401b-b13d-2ce0e1dd0539 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:31.428810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54da21-5d4b-401b-b13d-2ce0e1dd0539 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:31.434361 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3be52c-657e-4f4b-82c8-949752622f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:31.435005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be52c-657e-4f4b-82c8-949752622f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.435278 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be52c-657e-4f4b-82c8-949752622f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.435547 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3be52c-657e-4f4b-82c8-949752622f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.436197 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3be52c-657e-4f4b-82c8-949752622f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:31.438226 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3be52c-657e-4f4b-82c8-949752622f63 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:31.474097 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1423/2881] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:40:31 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:31.478949 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:31.491032 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab3440-2743-44ca-afbb-fb24c46db338 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:31.547368 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb616f6-803c-4d87-9246-00f9ab98d1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:31.547962 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb616f6-803c-4d87-9246-00f9ab98d1ad admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.548241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb616f6-803c-4d87-9246-00f9ab98d1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.548558 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb616f6-803c-4d87-9246-00f9ab98d1ad admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.549194 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb616f6-803c-4d87-9246-00f9ab98d1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:31.551134 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb616f6-803c-4d87-9246-00f9ab98d1ad admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:31.576344 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1459/2882] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:40:31 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:31.581029 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3be52c-657e-4f4b-82c8-949752622f63 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:31.591994 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3be52c-657e-4f4b-82c8-949752622f63 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:31.597531 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f12c9-591f-4ffa-b22e-e41ec5b356cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:31.598142 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f12c9-591f-4ffa-b22e-e41ec5b356cd admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.598422 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f12c9-591f-4ffa-b22e-e41ec5b356cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.598697 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f12c9-591f-4ffa-b22e-e41ec5b356cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.599364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f12c9-591f-4ffa-b22e-e41ec5b356cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:31.601004 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f12c9-591f-4ffa-b22e-e41ec5b356cd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:31.611460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1424/2883] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:31.615713 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb616f6-803c-4d87-9246-00f9ab98d1ad admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:31.626544 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb616f6-803c-4d87-9246-00f9ab98d1ad admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:31.631806 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad6e6c-4ca6-4dfe-a9b9-fd2093bd3804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:31.632468 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad6e6c-4ca6-4dfe-a9b9-fd2093bd3804 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.632738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad6e6c-4ca6-4dfe-a9b9-fd2093bd3804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.633008 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad6e6c-4ca6-4dfe-a9b9-fd2093bd3804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.633646 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad6e6c-4ca6-4dfe-a9b9-fd2093bd3804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:31.635273 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad6e6c-4ca6-4dfe-a9b9-fd2093bd3804 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:31.647066 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1460/2884] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:31.651348 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f12c9-591f-4ffa-b22e-e41ec5b356cd admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:31.662210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f12c9-591f-4ffa-b22e-e41ec5b356cd admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:31.668166 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:31.669179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.669602 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.669951 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] PATH_INFO: `/v3/projects/32bfa647a6dd483ebb81d9a32e6b9ea9/users/39825c3f197c4b9ba3c095562a585057/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.691559 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bfa647a6dd483ebb81d9a32e6b9ea9, user_id=39825c3f197c4b9ba3c095562a585057, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:31.694269 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:31.709931 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1425/2885] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:40:31 2022] PUT /identity/v3/projects/32bfa647a6dd483ebb81d9a32e6b9ea9/users/39825c3f197c4b9ba3c095562a585057/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:31.795710 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775781-9be2-410b-bdb9-c8fcd33fa175 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.796029 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775781-9be2-410b-bdb9-c8fcd33fa175 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.796197 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775781-9be2-410b-bdb9-c8fcd33fa175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.831430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-45775781-9be2-410b-bdb9-c8fcd33fa175 None None] MFA Rules not processed for user `39825c3f197c4b9ba3c095562a585057`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:31.832696 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-45775781-9be2-410b-bdb9-c8fcd33fa175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:31.904233 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1461/2886] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:31.916752 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:31.918861 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:31.980119 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080eaae-b79a-460a-a028-bf5ec04ee8e3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:31.985218 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb063e-1c62-4871-9421-0beb6c40ff41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:31.985886 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb063e-1c62-4871-9421-0beb6c40ff41 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:31.986158 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb063e-1c62-4871-9421-0beb6c40ff41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:31.986430 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb063e-1c62-4871-9421-0beb6c40ff41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:31.995632 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb063e-1c62-4871-9421-0beb6c40ff41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:31.997117 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb063e-1c62-4871-9421-0beb6c40ff41 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:32.007057 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1426/2887] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:41.901009 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:42.002887 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:43.714255 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775781-9be2-410b-bdb9-c8fcd33fa175 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:43.783831 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775781-9be2-410b-bdb9-c8fcd33fa175 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:43.788880 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:43.789517 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:43.789763 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:43.790067 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] PATH_INFO: `/v3/users/39825c3f197c4b9ba3c095562a585057` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:43.791250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39825c3f197c4b9ba3c095562a585057)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:43.793220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:43.848634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39825c3f197c4b9ba3c095562a585057'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:43.861460 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39825c3f197c4b9ba3c095562a585057'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:43.871994 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39825c3f197c4b9ba3c095562a585057'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:43.872619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39825c3f197c4b9ba3c095562a585057'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:43.873298 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39825c3f197c4b9ba3c095562a585057'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:43.887689 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1462/2888] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:40:43 2022] DELETE /identity/v3/users/39825c3f197c4b9ba3c095562a585057 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:43.892342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b288-a64e-4674-99d2-9e598c1663c4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:43.892877 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b288-a64e-4674-99d2-9e598c1663c4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:43.892977 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b288-a64e-4674-99d2-9e598c1663c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:43.912603 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9fb2b288-a64e-4674-99d2-9e598c1663c4 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:43.913815 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9fb2b288-a64e-4674-99d2-9e598c1663c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:43.974637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1427/2889] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:43.988447 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:43.990597 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:44.055533 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f79c2-9fbc-4d0c-83f4-98b74cb402e5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:44.060101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49da226-fb11-4ef1-b41b-7b4b3a5793b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:44.060754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49da226-fb11-4ef1-b41b-7b4b3a5793b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.061028 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49da226-fb11-4ef1-b41b-7b4b3a5793b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.061545 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49da226-fb11-4ef1-b41b-7b4b3a5793b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.072229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49da226-fb11-4ef1-b41b-7b4b3a5793b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:44.073716 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49da226-fb11-4ef1-b41b-7b4b3a5793b1 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:44.084624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1463/2890] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:44.370276 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b288-a64e-4674-99d2-9e598c1663c4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:44.371757 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9fb2b288-a64e-4674-99d2-9e598c1663c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:44.385350 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b288-a64e-4674-99d2-9e598c1663c4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:44.391966 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:44.392233 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.392506 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.392780 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] PATH_INFO: `/v3/projects/32bfa647a6dd483ebb81d9a32e6b9ea9` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.394038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bfa647a6dd483ebb81d9a32e6b9ea9)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:44.395990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:44.447710 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bfa647a6dd483ebb81d9a32e6b9ea9', 'request_id': 'req-11276ed5-afd0-49cf-97a3-bce0645c2f90'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:44.454516 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bfa647a6dd483ebb81d9a32e6b9ea9', 'request_id': 'req-11276ed5-afd0-49cf-97a3-bce0645c2f90'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:44.464160 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bfa647a6dd483ebb81d9a32e6b9ea9', 'request_id': 'req-11276ed5-afd0-49cf-97a3-bce0645c2f90'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:44.477250 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] The token cache is being invalidate because project 32bfa647a6dd483ebb81d9a32e6b9ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:40:44.477637 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:44.478401 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-11276ed5-afd0-49cf-97a3-bce0645c2f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:40:44.480170 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1428/2891] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:40:44 2022] DELETE /identity/v3/projects/32bfa647a6dd483ebb81d9a32e6b9ea9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:44.485286 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd05b-5e31-4f3c-8b73-25cf97bf4ea8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.485569 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd05b-5e31-4f3c-8b73-25cf97bf4ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.485839 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fd05b-5e31-4f3c-8b73-25cf97bf4ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.507283 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-323fd05b-5e31-4f3c-8b73-25cf97bf4ea8 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:44.508598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-323fd05b-5e31-4f3c-8b73-25cf97bf4ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:44.527241 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:44.574681 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1464/2892] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:44.583647 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605df943-d2b0-42e2-a0b2-4fde67f25038 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.583953 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605df943-d2b0-42e2-a0b2-4fde67f25038 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.584225 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605df943-d2b0-42e2-a0b2-4fde67f25038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.614926 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-605df943-d2b0-42e2-a0b2-4fde67f25038 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:44.616167 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-605df943-d2b0-42e2-a0b2-4fde67f25038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:44.625850 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1429/2893] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:44.630601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fd05b-5e31-4f3c-8b73-25cf97bf4ea8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:44.643300 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fd05b-5e31-4f3c-8b73-25cf97bf4ea8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:44.649360 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:44.650285 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.650749 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.651184 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.652138 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:40:44.652686 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:44.655277 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:44.668189 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1465/2894] 10.222.0.55 () {58 vars in 1153 bytes} [Tue Sep 13 12:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:40:44.673622 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605df943-d2b0-42e2-a0b2-4fde67f25038 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:44.683310 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605df943-d2b0-42e2-a0b2-4fde67f25038 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:44.689044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334129b3-fc11-4fb2-850d-886df7710256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:44.689643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334129b3-fc11-4fb2-850d-886df7710256 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.689927 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334129b3-fc11-4fb2-850d-886df7710256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.690195 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334129b3-fc11-4fb2-850d-886df7710256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.690827 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334129b3-fc11-4fb2-850d-886df7710256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:44.692783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334129b3-fc11-4fb2-850d-886df7710256 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:44.727556 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1430/2895] 10.222.0.55 () {60 vars in 1153 bytes} [Tue Sep 13 12:40:44 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:44.733750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:44.744139 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a54573-a910-4fee-8af9-a9896dee2fcc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:44.806027 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327baff-f19a-48f2-96b5-a5caa7cbdc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:44.806634 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327baff-f19a-48f2-96b5-a5caa7cbdc6c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.806910 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327baff-f19a-48f2-96b5-a5caa7cbdc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.807176 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327baff-f19a-48f2-96b5-a5caa7cbdc6c admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.807798 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327baff-f19a-48f2-96b5-a5caa7cbdc6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:44.809750 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327baff-f19a-48f2-96b5-a5caa7cbdc6c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:44.834198 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1466/2896] 10.222.0.55 () {60 vars in 1144 bytes} [Tue Sep 13 12:40:44 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:40:44.838712 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334129b3-fc11-4fb2-850d-886df7710256 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:44.850427 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334129b3-fc11-4fb2-850d-886df7710256 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:44.856005 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbca57-7d25-4194-8b8c-8e94f960f308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:44.856658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbca57-7d25-4194-8b8c-8e94f960f308 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.856938 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbca57-7d25-4194-8b8c-8e94f960f308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.857210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbca57-7d25-4194-8b8c-8e94f960f308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.857865 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbca57-7d25-4194-8b8c-8e94f960f308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:44.859545 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbca57-7d25-4194-8b8c-8e94f960f308 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:44.870220 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1431/2897] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:44.874540 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327baff-f19a-48f2-96b5-a5caa7cbdc6c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:44.884758 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327baff-f19a-48f2-96b5-a5caa7cbdc6c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:44.890085 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf0878-2bae-48fb-9be9-62fa7b1c66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:44.890683 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0878-2bae-48fb-9be9-62fa7b1c66ba admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.890953 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0878-2bae-48fb-9be9-62fa7b1c66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.891218 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0878-2bae-48fb-9be9-62fa7b1c66ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.891847 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf0878-2bae-48fb-9be9-62fa7b1c66ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:44.893472 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf0878-2bae-48fb-9be9-62fa7b1c66ba admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:44.904408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1467/2898] 10.222.0.55 () {58 vars in 1122 bytes} [Tue Sep 13 12:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:40:44.908771 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbca57-7d25-4194-8b8c-8e94f960f308 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:44.932737 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbca57-7d25-4194-8b8c-8e94f960f308 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:44.938189 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:44.938867 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.939151 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.939428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] PATH_INFO: `/v3/projects/a58e9b676a974883a1b08b266c6e9634/users/b2866bfcd8f14f7ea6b5bb0abe59e7bd/roles/82ff5c8680ab48edba50f88b12a0c000` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:44.959364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58e9b676a974883a1b08b266c6e9634, user_id=b2866bfcd8f14f7ea6b5bb0abe59e7bd, role_id=82ff5c8680ab48edba50f88b12a0c000)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:44.962090 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:44.979883 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1432/2899] 10.222.0.55 () {60 vars in 1483 bytes} [Tue Sep 13 12:40:44 2022] PUT /identity/v3/projects/a58e9b676a974883a1b08b266c6e9634/users/b2866bfcd8f14f7ea6b5bb0abe59e7bd/roles/82ff5c8680ab48edba50f88b12a0c000 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:40:44.985408 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21b410-cc18-4763-9780-39b6be52b521 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:44.985703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21b410-cc18-4763-9780-39b6be52b521 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:44.986000 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21b410-cc18-4763-9780-39b6be52b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:45.007648 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fb21b410-cc18-4763-9780-39b6be52b521 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:45.008912 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fb21b410-cc18-4763-9780-39b6be52b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:45.081220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1468/2900] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:45.094706 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:45.097345 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:45.125100 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:45.165727 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa8ee6-f84b-4468-9dbd-aa5148e5dfb0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:45.170016 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:45.170913 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:45.172300 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:45.172604 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:45.182360 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:45.183806 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:45.194684 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1433/2901] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:45.906274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8cd3a-f14b-48ba-afcf-bc47a572d000 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:45.906274 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8cd3a-f14b-48ba-afcf-bc47a572d000 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:45.907026 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8cd3a-f14b-48ba-afcf-bc47a572d000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:45.936322 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dda8cd3a-f14b-48ba-afcf-bc47a572d000 None None] MFA Rules not processed for user `b2866bfcd8f14f7ea6b5bb0abe59e7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:45.937601 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dda8cd3a-f14b-48ba-afcf-bc47a572d000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:45.955903 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:46.012627 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1469/2902] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:46.024494 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:40:46.025959 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:46.093237 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d106-f98b-4431-92e7-32e7432557d2 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:40:46.097274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ab7a-6775-49bf-9b51-4173673186c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b8243a35594402943d956a93cda7b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:40:46.097895 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ab7a-6775-49bf-9b51-4173673186c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:46.098178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ab7a-6775-49bf-9b51-4173673186c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:46.098457 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ab7a-6775-49bf-9b51-4173673186c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:46.107821 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ab7a-6775-49bf-9b51-4173673186c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:40:46.109342 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ab7a-6775-49bf-9b51-4173673186c2 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:40:46.119721 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1434/2903] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:40:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:40:47.546053 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba14e4-e725-41ac-9c3f-60d5feb2982c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:40:47.546667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba14e4-e725-41ac-9c3f-60d5feb2982c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:40:47.546667 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba14e4-e725-41ac-9c3f-60d5feb2982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:40:47.567744 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3bba14e4-e725-41ac-9c3f-60d5feb2982c None None] MFA Rules not processed for user `b2866bfcd8f14f7ea6b5bb0abe59e7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:40:47.569182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3bba14e4-e725-41ac-9c3f-60d5feb2982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:40:47.577918 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1470/2904] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:40:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:40:56.114962 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=43 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:40:57.561537 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=22 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:41:15.370371 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30c73-f335-4ad6-b7b4-89cbcf5d830d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:15.371043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30c73-f335-4ad6-b7b4-89cbcf5d830d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:15.371043 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30c73-f335-4ad6-b7b4-89cbcf5d830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:15.393779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-eac30c73-f335-4ad6-b7b4-89cbcf5d830d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:41:15.394981 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-eac30c73-f335-4ad6-b7b4-89cbcf5d830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:15.406228 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1435/2905] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:41:15.430065 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba14e4-e725-41ac-9c3f-60d5feb2982c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:15.432431 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3bba14e4-e725-41ac-9c3f-60d5feb2982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:15.517266 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba14e4-e725-41ac-9c3f-60d5feb2982c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:15.523264 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:15.523863 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:15.524182 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:15.524549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:15.534488 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:15.536110 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:15.546896 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1471/2906] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:41:18.476141 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e8a8d-2638-4743-872c-b3c9bada1e4e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:18.476759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e8a8d-2638-4743-872c-b3c9bada1e4e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:18.476759 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e8a8d-2638-4743-872c-b3c9bada1e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:18.497918 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-863e8a8d-2638-4743-872c-b3c9bada1e4e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:41:18.499125 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-863e8a8d-2638-4743-872c-b3c9bada1e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:18.507961 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1436/2907] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:41:18.530297 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:18.531828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:18.546761 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13523-4cdf-4418-a472-e29ed5b46f81 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:18.552624 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca31ef-95d0-4534-bf87-fab0d4d149c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:18.553224 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca31ef-95d0-4534-bf87-fab0d4d149c3 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:18.553491 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca31ef-95d0-4534-bf87-fab0d4d149c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:18.553754 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca31ef-95d0-4534-bf87-fab0d4d149c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:18.562530 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca31ef-95d0-4534-bf87-fab0d4d149c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:18.564101 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca31ef-95d0-4534-bf87-fab0d4d149c3 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:18.574727 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1472/2908] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:41:21.772319 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e091-cd55-4012-858e-cd770b74ef66 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:21.772897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e091-cd55-4012-858e-cd770b74ef66 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:21.772897 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3e091-cd55-4012-858e-cd770b74ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:21.797498 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cfa3e091-cd55-4012-858e-cd770b74ef66 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:41:21.798725 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cfa3e091-cd55-4012-858e-cd770b74ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:21.808828 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1437/2909] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:41:21.830514 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca31ef-95d0-4534-bf87-fab0d4d149c3 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:21.843342 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca31ef-95d0-4534-bf87-fab0d4d149c3 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:21.850505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0890e70-c207-456b-953e-383e29ea5cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:21.851116 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0890e70-c207-456b-953e-383e29ea5cf0 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:21.851390 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0890e70-c207-456b-953e-383e29ea5cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:21.851658 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0890e70-c207-456b-953e-383e29ea5cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:21.861142 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0890e70-c207-456b-953e-383e29ea5cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:21.862748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0890e70-c207-456b-953e-383e29ea5cf0 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:21.872508 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1473/2910] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:41:25.049810 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aafed-d2f3-4b7e-b276-37e5748f799d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:25.050420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aafed-d2f3-4b7e-b276-37e5748f799d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:25.050420 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aafed-d2f3-4b7e-b276-37e5748f799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:25.071377 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-804aafed-d2f3-4b7e-b276-37e5748f799d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:41:25.072584 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-804aafed-d2f3-4b7e-b276-37e5748f799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:25.081199 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1438/2911] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:41:25.105296 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0890e70-c207-456b-953e-383e29ea5cf0 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:25.123250 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0890e70-c207-456b-953e-383e29ea5cf0 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:25.132057 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa80e-6a79-4f19-8f15-b37acbce8a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:25.132692 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa80e-6a79-4f19-8f15-b37acbce8a1a service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:25.133071 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa80e-6a79-4f19-8f15-b37acbce8a1a service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:25.133417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfa80e-6a79-4f19-8f15-b37acbce8a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:25.147417 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa80e-6a79-4f19-8f15-b37acbce8a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:25.149315 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfa80e-6a79-4f19-8f15-b37acbce8a1a service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:25.162961 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1474/2912] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:41:28.240873 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64ee42-5bd2-465f-9ee4-1b5ce87eebac None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:28.242096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64ee42-5bd2-465f-9ee4-1b5ce87eebac None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:28.242696 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64ee42-5bd2-465f-9ee4-1b5ce87eebac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:28.266517 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7c64ee42-5bd2-465f-9ee4-1b5ce87eebac None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:41:28.267836 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7c64ee42-5bd2-465f-9ee4-1b5ce87eebac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:28.277143 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1439/2913] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:41:28.300709 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa80e-6a79-4f19-8f15-b37acbce8a1a service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:28.312587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfa80e-6a79-4f19-8f15-b37acbce8a1a service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:28.318965 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcfabb-49a6-4565-853f-b9b7e94116d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:28.319572 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfabb-49a6-4565-853f-b9b7e94116d3 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:28.319846 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfabb-49a6-4565-853f-b9b7e94116d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:28.320108 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfabb-49a6-4565-853f-b9b7e94116d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:28.328920 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcfabb-49a6-4565-853f-b9b7e94116d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:28.330499 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcfabb-49a6-4565-853f-b9b7e94116d3 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:28.340045 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1475/2914] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:41:31.408458 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c21f3-3cf7-429d-9020-ee8e0c64e082 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:31.409133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c21f3-3cf7-429d-9020-ee8e0c64e082 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:31.409133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c21f3-3cf7-429d-9020-ee8e0c64e082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:31.435462 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e99c21f3-3cf7-429d-9020-ee8e0c64e082 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:41:31.436782 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e99c21f3-3cf7-429d-9020-ee8e0c64e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:31.446210 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1440/2915] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:41:31.470793 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcfabb-49a6-4565-853f-b9b7e94116d3 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:31.485971 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcfabb-49a6-4565-853f-b9b7e94116d3 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:31.492409 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:31.493007 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:31.493270 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:31.493539 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:31.504827 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:31.507095 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:31.521158 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1476/2916] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:41:41.429094 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=18 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:41:41.515649 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=64 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:41:45.640044 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c5ce-d4ca-4a8f-af52-1a3c7150840f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:45.640683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c5ce-d4ca-4a8f-af52-1a3c7150840f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:45.640683 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c5ce-d4ca-4a8f-af52-1a3c7150840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:45.665577 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-13c9c5ce-d4ca-4a8f-af52-1a3c7150840f None None] MFA Rules not processed for user `b2866bfcd8f14f7ea6b5bb0abe59e7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:41:45.667086 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-13c9c5ce-d4ca-4a8f-af52-1a3c7150840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:45.676519 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1441/2917] 10.222.0.55 () {58 vars in 958 bytes} [Tue Sep 13 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:41:55.658999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:41:57.660477 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:57.663099 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:57.682097 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a71b7-56cc-44a4-9d07-5b3b087553db service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:57.688187 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:57.688923 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:57.689206 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:57.689480 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] PATH_INFO: `/v3/users/02fa18f019ae4abf99a256638acd9ec3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:57.691587 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fa18f019ae4abf99a256638acd9ec3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:57.694419 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:57.757141 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fa18f019ae4abf99a256638acd9ec3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:57.773303 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fa18f019ae4abf99a256638acd9ec3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:57.782560 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fa18f019ae4abf99a256638acd9ec3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:57.783619 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fa18f019ae4abf99a256638acd9ec3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:57.785112 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fa18f019ae4abf99a256638acd9ec3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:57.801840 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1477/2918] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:41:57 2022] DELETE /identity/v3/users/02fa18f019ae4abf99a256638acd9ec3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:41:58.004423 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c5ce-d4ca-4a8f-af52-1a3c7150840f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:58.017874 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c5ce-d4ca-4a8f-af52-1a3c7150840f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:58.091997 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:58.092596 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:58.092905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:58.093186 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] PATH_INFO: `/v3/projects/bbb89bbb7c554f7e8d599032a90839d9` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:58.094480 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb89bbb7c554f7e8d599032a90839d9)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:58.096521 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:58.151067 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb89bbb7c554f7e8d599032a90839d9', 'request_id': 'req-ae99505f-2ae6-4c81-836d-638c87e550da'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.160899 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb89bbb7c554f7e8d599032a90839d9', 'request_id': 'req-ae99505f-2ae6-4c81-836d-638c87e550da'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.170640 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb89bbb7c554f7e8d599032a90839d9', 'request_id': 'req-ae99505f-2ae6-4c81-836d-638c87e550da'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.182643 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] The token cache is being invalidate because project bbb89bbb7c554f7e8d599032a90839d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:41:58.182919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.183569 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.185115 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1442/2919] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:41:58 2022] DELETE /identity/v3/projects/bbb89bbb7c554f7e8d599032a90839d9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:41:58.189513 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:58.191107 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:58.207921 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d259143-30b3-4881-9a1a-487fdd75e613 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:58.272025 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:58.272695 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:58.272969 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:58.273232 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] PATH_INFO: `/v3/users/6f572d2ec93c4e758d559b839afe603e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:58.274425 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f572d2ec93c4e758d559b839afe603e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:58.276349 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:58.329011 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f572d2ec93c4e758d559b839afe603e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.343623 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f572d2ec93c4e758d559b839afe603e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.353985 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f572d2ec93c4e758d559b839afe603e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.354703 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f572d2ec93c4e758d559b839afe603e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.355588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1718a6c6-b7b4-42b3-9df3-11aae9fc9807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f572d2ec93c4e758d559b839afe603e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.358610 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:41:58.373844 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1478/2920] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:41:58 2022] DELETE /identity/v3/users/6f572d2ec93c4e758d559b839afe603e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:41:58.574708 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:58.576352 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:58.591919 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99505f-2ae6-4c81-836d-638c87e550da admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:58.661113 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:58.661783 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:58.662061 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:58.662338 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] PATH_INFO: `/v3/projects/f9213d19c218463287c9bb4324d60372` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:58.663674 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9213d19c218463287c9bb4324d60372)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:58.665654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:58.706179 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:41:58.725396 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9213d19c218463287c9bb4324d60372', 'request_id': 'req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.734032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9213d19c218463287c9bb4324d60372', 'request_id': 'req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.744267 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9213d19c218463287c9bb4324d60372', 'request_id': 'req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.756271 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] The token cache is being invalidate because project f9213d19c218463287c9bb4324d60372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:41:58.756593 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.757381 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:41:58.759007 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1443/2921] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:41:58 2022] DELETE /identity/v3/projects/f9213d19c218463287c9bb4324d60372 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:41:59.192202 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9454-7dff-4a3b-b0cf-4baada20e56d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:59.192851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9454-7dff-4a3b-b0cf-4baada20e56d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:59.192851 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9454-7dff-4a3b-b0cf-4baada20e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:59.214199 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3b1b9454-7dff-4a3b-b0cf-4baada20e56d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:41:59.215430 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3b1b9454-7dff-4a3b-b0cf-4baada20e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:59.289398 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1479/2922] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:41:59.309722 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:41:59.311274 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:41:59.399999 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00a1f3-9123-4680-ad5f-9fdd4b77e1f2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:41:59.406658 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:41:59.407294 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:41:59.407570 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:41:59.407838 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:41:59.417803 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:41:59.419433 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:41:59.430538 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1444/2923] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:42:02.462596 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acf09b-a13d-4006-8d3d-f5ec2345791e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:02.463204 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acf09b-a13d-4006-8d3d-f5ec2345791e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:02.463316 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acf09b-a13d-4006-8d3d-f5ec2345791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:02.487207 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f7acf09b-a13d-4006-8d3d-f5ec2345791e None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:42:02.488549 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f7acf09b-a13d-4006-8d3d-f5ec2345791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:42:02.498871 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1480/2924] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:42:02.520133 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:42:02.522096 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:42:02.539136 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01f76-b3d0-45c9-b1de-6fc8184cb627 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:42:02.546295 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ee67f-4a2f-4716-82c6-b6e07bb9022a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:42:02.546929 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee67f-4a2f-4716-82c6-b6e07bb9022a service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:02.547212 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee67f-4a2f-4716-82c6-b6e07bb9022a service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:02.547487 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee67f-4a2f-4716-82c6-b6e07bb9022a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:02.557147 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ee67f-4a2f-4716-82c6-b6e07bb9022a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:42:02.558772 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ee67f-4a2f-4716-82c6-b6e07bb9022a service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:42:02.570234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1445/2925] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:42:05.567269 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12fb5-1180-4c04-b08d-b98ca792210d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:05.567876 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12fb5-1180-4c04-b08d-b98ca792210d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:05.568121 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12fb5-1180-4c04-b08d-b98ca792210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:05.591748 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-02b12fb5-1180-4c04-b08d-b98ca792210d None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:42:05.593019 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-02b12fb5-1180-4c04-b08d-b98ca792210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:42:05.601442 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1481/2926] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:42:05.636825 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ee67f-4a2f-4716-82c6-b6e07bb9022a service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:42:05.650315 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ee67f-4a2f-4716-82c6-b6e07bb9022a service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:42:05.656839 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6867e-9c77-4238-9e47-03a18457ba28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:42:05.657439 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6867e-9c77-4238-9e47-03a18457ba28 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:05.657720 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6867e-9c77-4238-9e47-03a18457ba28 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:05.657986 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6867e-9c77-4238-9e47-03a18457ba28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:05.672038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6867e-9c77-4238-9e47-03a18457ba28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:42:05.676717 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6867e-9c77-4238-9e47-03a18457ba28 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:42:05.689657 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1446/2927] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:42:08.747136 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f14c-92e7-4b0d-af2a-e197586807db None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:08.747722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f14c-92e7-4b0d-af2a-e197586807db None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:08.747722 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f14c-92e7-4b0d-af2a-e197586807db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:08.768828 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a704f14c-92e7-4b0d-af2a-e197586807db None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:42:08.770050 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a704f14c-92e7-4b0d-af2a-e197586807db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:42:08.778220 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1482/2928] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:42:08.802746 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6867e-9c77-4238-9e47-03a18457ba28 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:42:08.815325 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6867e-9c77-4238-9e47-03a18457ba28 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:42:08.821849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e1321-7edb-4710-84d5-6406ab72e2e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:42:08.822394 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e1321-7edb-4710-84d5-6406ab72e2e5 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:08.822676 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e1321-7edb-4710-84d5-6406ab72e2e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:08.822954 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e1321-7edb-4710-84d5-6406ab72e2e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:08.832428 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e1321-7edb-4710-84d5-6406ab72e2e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:42:08.834150 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e1321-7edb-4710-84d5-6406ab72e2e5 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:42:08.844856 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1447/2929] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:42:11.940336 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a228d1e-cfb4-4ec7-805a-41efc2d775a5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:11.940954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a228d1e-cfb4-4ec7-805a-41efc2d775a5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:11.940954 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a228d1e-cfb4-4ec7-805a-41efc2d775a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:11.961563 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0a228d1e-cfb4-4ec7-805a-41efc2d775a5 None None] MFA Rules not processed for user `53ef2f00d00d49c8b7371a64b8d190ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:42:11.962951 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a228d1e-cfb4-4ec7-805a-41efc2d775a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:42:11.972279 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1483/2930] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Sep 13 12:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:42:11.997112 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e1321-7edb-4710-84d5-6406ab72e2e5 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:42:12.010038 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e1321-7edb-4710-84d5-6406ab72e2e5 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:42:12.017006 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536e042f0d76408b9379af15526878b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:42:12.017625 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:12.017905 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:12.018181 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:12.027518 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:42:12.029235 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:42:12.039040 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1448/2931] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:42:18.888358 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a228d1e-cfb4-4ec7-805a-41efc2d775a5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:42:18.890476 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a228d1e-cfb4-4ec7-805a-41efc2d775a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:42:18.962738 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a228d1e-cfb4-4ec7-805a-41efc2d775a5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:42:18.967346 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b310f17f81e040ac80dc1b9de52026f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:42:18.967956 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:18.968229 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:18.968519 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:18.970483 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:42:18.985399 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:42:18.986888 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:42:18.998087 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1484/2932] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:42:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:42:22.034714 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=70,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:42:28.993023 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=69 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:42:40.672178 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:42:40.673830 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:42:40.690364 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdb89a-08b4-4c49-bba7-50aa55726e0f service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:42:40.696692 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:42:40.697627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:40.697627 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:40.697888 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] PATH_INFO: `/v3/users/b2866bfcd8f14f7ea6b5bb0abe59e7bd` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:40.699221 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2866bfcd8f14f7ea6b5bb0abe59e7bd)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:42:40.701234 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:42:40.762180 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2866bfcd8f14f7ea6b5bb0abe59e7bd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:40.771182 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2866bfcd8f14f7ea6b5bb0abe59e7bd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:40.771820 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2866bfcd8f14f7ea6b5bb0abe59e7bd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:40.772460 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2866bfcd8f14f7ea6b5bb0abe59e7bd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:40.780024 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2866bfcd8f14f7ea6b5bb0abe59e7bd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:40.801656 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1449/2933] 10.222.0.55 () {58 vars in 1224 bytes} [Tue Sep 13 12:42:40 2022] DELETE /identity/v3/users/b2866bfcd8f14f7ea6b5bb0abe59e7bd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:42:41.009586 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:42:41.027872 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e9fb-67b7-4813-a24c-97cec1aedc13 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:42:41.105374 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53ef2f00d00d49c8b7371a64b8d190ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ed37889d9bd46b8ac01745f81e76c42', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:42:41.106039 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:42:41.106320 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:42:41.106588 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] PATH_INFO: `/v3/projects/a58e9b676a974883a1b08b266c6e9634` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:42:41.107760 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58e9b676a974883a1b08b266c6e9634)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:42:41.109742 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:42:41.176583 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58e9b676a974883a1b08b266c6e9634', 'request_id': 'req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:41.186505 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58e9b676a974883a1b08b266c6e9634', 'request_id': 'req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:41.194235 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58e9b676a974883a1b08b266c6e9634', 'request_id': 'req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:41.208582 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] The token cache is being invalidate because project a58e9b676a974883a1b08b266c6e9634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:42:41.209014 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:41.209577 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7b272a3e-7b9a-41be-98cb-97e6d43e8cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:42:41.211125 dv-cinder-855189-2-smb devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1485/2934] 10.222.0.55 () {58 vars in 1233 bytes} [Tue Sep 13 12:42:41 2022] DELETE /identity/v3/projects/a58e9b676a974883a1b08b266c6e9634 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:42:50.796826 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:42:51.203598 dv-cinder-855189-2-smb devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:45:20.898990 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:45:20.900896 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:45:20.979813 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee171b-600e-4646-b587-ff10a2b09679 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:45:21.046654 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf69766-d1b1-4c07-a38c-b1eccddc8339 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee6a88b338342c7ab991c5511e7b115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a57dd3f74a548a9bdee57f1cdacf5be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:45:21.047289 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69766-d1b1-4c07-a38c-b1eccddc8339 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:45:21.047571 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69766-d1b1-4c07-a38c-b1eccddc8339 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:45:21.047849 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69766-d1b1-4c07-a38c-b1eccddc8339 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:45:21.049794 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-faf69766-d1b1-4c07-a38c-b1eccddc8339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:45:21.063032 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf69766-d1b1-4c07-a38c-b1eccddc8339 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:45:21.064817 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf69766-d1b1-4c07-a38c-b1eccddc8339 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:45:21.076779 dv-cinder-855189-2-smb devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1450/2935] 10.222.0.55 () {60 vars in 1365 bytes} [Tue Sep 13 12:45:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:45:31.071266 dv-cinder-855189-2-smb devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=58 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}